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Abstract 

Sequence transformations are important tools for the convergence acceleration of 
slowly convergent scalar sequences or series and for the summation of divergent series. 
The basic idea is to construct from a given sequence Ss„J a new sequence ^s'„^ = 
T(-f s„ J) where each s'„ depends on a finite number of elements s„j , . . . , s„„ . Often, the 
Sn are the partial sums of an infinite series. The aim is to find transformations such that 
■§^sjj J converges faster than (or sums) Ss„ J. 

Transformations T(-§^s„ J, -J^a;,! J) that depend not only on the sequence elements or 
partial sums Sn but also on an auxiliary sequence of so-called remainder estimates u!„ 
are of Levin- type if they are linear in the Sn, and nonlinear in the ujn- Such remainder 
estimates provide an easy-to-use possibility to use asymptotic information on the problem 
sequence for the construction of highly efficient sequence transformations. As shown first 
by Levin, it is possible to obtain such asymptotic information easily for large classes of 
sequences in such a way that the w„ are simple functions of a few sequence elements s„. 
Then, nonlinear sequence transformations are obtained. Special cases of such Levin-type 
transformations belong to the most powerful currently known extrapolation methods for 
scalar sequences and series. 

Here, we review known Levin- type sequence transformations and put them in a com- 
mon theoretical framework. It is discussed how such transformations may be constructed 
by either a model sequence approach or by iteration of simple transformations. As illus- 
tration, two new sequence transformations are derived. Common properties and results on 
convergence acceleration and stability are given. For important special cases, extensions 
of the general results are presented. Also, guidelines for the application of Levin-type 
sequence transformations are discussed, and a few numerical examples are given. 
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1 Introduction 



In applied mathematics and the numerate sciences, extrapolation methods are often used for 
the convergence acceleration of slowly convergent sequences or series and for the summation 
of divergent series. For an introduction to such methods, and also further information that 



cannot be covered here, see the books of Brezinski and Redivo Zaglia and Wimp [102| 
and the work of Weniger p^,|8^ and Homeier , but also the books of Baker ||] , Baker and 
Graves-Morris Brezinski ]'?],^|,p^-p^, Graves-Morris |^,|2^, Graves-Morris, Saff and Varga 
, Khovanskii Js^, Lorentzen and Waadeland , Nikishin and Sorokin Jg^, Petrushev and 
Popov , Ross [ |67[ , Saff and Varga , Wall , Werner and Buenger [ |101[ | and Wuytack 

For the discussion of extrapolation methods, one considers a sequence ^^t^^ — ^-^o? -^ii ■ ■ 
with elements s„ or the terms a„ = s„ — s„_i of a series X^jlo % with partial sums s„ = 
SJ=o ^'^^ large n. A common approach is to rewrite s„ as 

s„ = s + Rn (!) 

where s is the limit (or antilimit in the case of divergence) and i?„ is the remainder or tail. 
The aim then is to find a new sequence -Js'^S such that 

s'^ = s + R'„, R'n/Rn ^ for n -> oo . (2) 

Thus, the sequence \s'^^ converges faster to the limit s (or diverges less violently) than -S^Snl-. 

To find the sequence -S^sJ^jg-, i.e., to construct a sequence transformation ^s'^^^ = ^(-^SnJ), 
one needs asymptotic information about the s„ or the terms a„ for large n, and hence about 
the Rn- This information then allows to eliminate the remainder at least asymptotically, 
for instance by substracting the dominant part of the remainder. Either such information is 
obtained by a careful mathematical analysis of the behavior of the s„ and/or a,i, or it has 
to be extracted numerically from the values of a finite number of the s„ and/or a„ by some 
method that ideally can be proven to work for a large class of problems. 

Suppose that one knows quantities w„ such that Rn/wn — 0{1) for n — > oo, for instance 

lim Rn/ujn = c ^ (3) 

n — *oo 

where c is a constant. Such quantities are called remainder estimates. Quite often, such 
remainder estimates can be found with relatively low effort but the exact value of c is often 
quite hard to calculate. Then, it is rather natural to rewrite the rest as i?„ — LUniJ-n where 
fin c. The problem is how to describe or model the /i„. Suppose that one has a system of 
known functions '0J■(f^) such that '0o("-) = 1 and ^j+i = o('ijjj{n)) for j £ Nq- An example of 
such a system is i^j{n) — {n + (3)^^ for some f3 G ]R.-|_. Then, one may model /i„ as a linear 
combination of the ijjj (n) according to 

oo 

fin Cj'(/'j(n) for n — > c» , (4) 

3=0 

whence the problem sequence is modelled according to 

oo 

Sn ^ S + UJn'^Cjtpj(n) . (5) 

i=o 

The idea now is to eliminate the leading terms of the remainder with the unknown constants 
Cj up to j = — 1, say. Thus, one uses a model sequence with elements 

fc-i 

o-m = cr + uj„i ^ Cjt/jj (m) , m G No (6) 

j=0 
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and calculates a exactly by solving the system of + 1 equations resulting for to = n, n + 
1, . . . , n + fc for the unknowns tr and c-,-, j = 0, . . . , fc — 1. The solution for (t is a ratio of 
determinants (see below) and may be denoted symbolically as 

a = T(o-„, . . . ,cr„+fc; . . . ,ujn+k;i>j{n), ■ . - ^ipjin + k)) . (7) 

The resulting sequence transformation is 

npn}, M) = iTi'HM, M)} (8) 

with 

It eliminates the leading terms of the asymptotic expansion (^. The model sequences (^) are 
in the kernel of the sequence transformation T, defined as the set of all sequences such that 
T reproduces their (anti)limit exactly. 

A somewhat more general approach is based on model sequences of the form 

k 

cr„ = (T + ^ Cjgj{n), n e No, e N . (10) 
Virtually all known sequence transformations can be derived using such model sequences. 



This leads to the E algorithm as described below in Section 3.1. Also, some further important 
examples of sequence transformations are described in Section |^. 

However, the introduction of remainder estimates proved to be an important theoretical 
step since it allows to make use of asymptotic information of the remainder easily. The most 
prominent of the resulting sequence transformations T{^Sn^, "S^nS) is the Levin transforma- 
tion that corresponds to the asymptotic system of functions given by ipj{n) = [n + /3)~^, 
and thus, to Poincare-type expansions of the /i„. But also other systems are of importance, 
like i'jin) — l/(n + leading to factorial series, or V'i(") = in corresponding to Taylor 
expansions of t-dependent functions at the abscissae t„ that tend to zero for large n. The 
question which asymptotic system is best, cannot be decided generally. The answer to this 
question depends on the extrapolation problem. To obtain efficient extrapolation procedures 
for large classes of problems requires to use various asymptotic systems, and thus, a larger 
number of different sequence transformations. Also, different choices of a;„ lead to different 



variants of such transformations. Levin |53| has pioneered this question and introduced three 
variants that are both simple and rather successful for large classes of problems. These vari- 
ants and some further ones will be discussed. The question which variant is best, also cannot 
be decided generally. There are, however, a number of results that favor certain variants for 
certain problems. For example, for Stieltjes series, the choice ujn — fln+i can be theoretically 
justified (see Appendix^). 

Thus, we will focus on sequence transformations that involve an auxiliary sequence |^cij„§. 
To be more specific, we consider transformations of the form T[\sn^, S'^il) — ^'^^^ 

k 

E,(fc) Sn+j 
Kr, 



n+j 



ri'^ - ^ (11) 

V 1 

3=0 

This will be called a Levin-type transformation. The known sequence transformations that 
involve remainder estimates, for instance the C, S, and M transformation of Weniger 0|, the 
W algorithm of Sidi |^^, and the J transformation of Homeier with its many special cases 



like the important pJ transformations |35|,|36|,|38H4C,46|, are all of this type. Interestingly, 



also the H, T, and IC transformations of Homcicr ||34|35|, FH^OI^^H for the extrapolation of 
orthogonal expansions are of this type although the a;„ in some sense cease to be remainder 
estimates as defined in Eq. (||). 

The Levin transformation was also generalized in a different way by Levin and Sidi 
who introduced the d^™^ transformations. This is an important class of transformations that 
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would deserve a thorough review itself. This, however, is outside the scope of the pre sent 
review. We collect some important facts regarding this class of transformations in Section |3.2| . 

Levin-type transformations as defined in Eq. ( pi] ) have been used for the solution of a large 
variety of problems. For instance. Levin-type sequence transformations have be applied for 
the convergence acceleration of infinite series representations of molecular integrals |p8|,p9|,^, 
|65|,|8^,[9^L00|, for the calculation of the Hneshape of spectral holes 



9| , for the extrapolation 
of cluster- and crystal-orbital calculations of one-dimensional polymer chains to infinite chain 
length ||l|,|88[|3' ^'^^ ^^le calculation of special functions [||,^,|8|,||,||,|4[|l0§, for the 
summation of divergent and acceleration of convergent quantum mechanical perturbation 

for the evaluation of scmiinfinite integrals with oscillating 



series 



17, 18, 2 



integrands and Sommerfeld integral tails ^ , 61 , 75|,^ , and for the convergence acceleration of 
multipolar and orthogonal expansions and Fourier scries @ H, 13 |6|, ^, |§ . This list 
is clearly not complete but sufficient to demonstrate the possibility of successful application 
of these transformations. 

The outline of this survey is as follows: After listing some definitions and notations, we 
discuss some basic sequence transformations in order to provide some background information. 
Then, special definitions relevant for Levin-type sequence transformations are given, including 
variants obtained by choosing specific remainder estimates ujn. After this, important exam- 
ples of Levin-type sequence transformations are introduced. In Section ^ we will discuss 
approaches for the construction of Levin-type sequence transformations, including model se- 
quences, kernels and annihilation operators, and also the concept of hierarchical consistency. 
In Section ^, we derive basic properties, those of limiting transformations and discuss the ap- 
plication to power series. In Section results on convergence acceleration are presented, while 
in Section ^, results on the numerical stability of the transformations are provided. Finally, 
we discuss guidelines for the application of the transformations and some numerical examples 
in Section ^. 



2 Definitions and Notations 

2.1 General Definitions 
2.1.1 Sets 
Natural Numbers: 

N= {1,2,3,...}, No=NU{0} (12) 

Integer Numbers: 

Z = NU{0,-l,-2,-3, ...} (13) 

Real Numbers and Vectors: 

M = {a; : x real}, 

M+ {x e M : X > 0}, (14) 
M" = {(xi,...,a:„) |x, G M, j = 1, n} 



Complex Numbers: 



C = {z = X + iy: xgR, j/gM, i^ = -1} 
C" = {(zi,...,z„)|zjGC,j = l,...,n} 



(15) 



For z = X + iy, real and imaginary parts are denoted as x = 5ft(z), y — '^{z). We use IK to 
denote R or C. 

Vectors with nonvanishing components: 

F" = {(zi, z„) I z, e C, z, ^0,j = 1, n} (16) 
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Polynomials: 

k 

¥^ = {P : z ^^^CjzJ 



zeC,(co,...,Cfc) eK^'+'} (17) 



Sequences: 

€ K, n G No} (18) 

Sequences with nonvanishing terms: 

^ 0, s„ e K, n G No} (19) 

2.1.2 Special Functions and Symbols 



Gamma function 58, p. 1]: 

/"OO 

r(z) = / exp{-t)dt {z G R+) (20) 

Jo 



Factorial: 



n! = r(n+l) = []j (21) 



Pochhammer Symbol p. 2]: 



, , T(a + ?i) -i-r , , , , 

(«)«= L ^ =n(«+j'-i) (22) 



Binomial Coefficients ||, p. 256, Eq. (6.1.21)]: 

_ r(z + i) 



r(w + i)r(z-w + i) 



Entier Function: 



(23) 



Ixj = max{j el : j < X, X eM} (24) 



2.2 Sequences, Series and Operators 
2.2.1 Sequences and Series 

For Stieltjes series see Appendix ^. 

Scalar Sequences with Elements s„, Tail i?„, and Limit s: 

Ss«}} = {{snS-ir=o = {{so,si, S2, • ■ ■}} e §^ , Rn^Sn-s, Hm s„ = s . (25) 

n — *oo 

If the sequence is not convergent but summable to s, s is called the Antilimit. The n-th 
element s„ of a sequence cr = -g^SnJ- G S"^ is also denoted by (ct)„. A sequence is called a 
constant sequence, if all elements are constant, i.e., if there is a c G IK such that s„ = c for 
all rt G No, in which case it is denoted by ^cj. The constant sequence |^0§ is called the zero 
sequence. 

Scalar Series with Terms aj G K, Partial Sums s„. Tail i?„, and Limit/ Antilimit s: 

oo n oo 

s = ^ , s„ = ^ flj , R„ = - ^ flj = s„ - s (26) 

j=0 j=0 j=n+l 

We say that a„ are Kummer-related to the a„ with limit or antilimit s if a„ = As„_i satisfy 
On ~ On for n ^ cxD and s is the limit (or antilimit) of s„ = X]j=o ^j- 
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Scalar Power Series in ^ e C with coefficients cj e K, Partial Sums fn{z), Tail Rn{z), 
and Limit/ Antilimit f{z): 

oo n oo 

f{z)=Y,c,z^, Mz) = J2cjz\ R^{z)= ^ c^z^ = f{z)-Uz) (27) 

2.2.2 Types of Convergence 

Sequences ^Sn^ satisfying the equation 

lim {Sn+l - s)/ {Sn - s) = p (28) 
n— >oo 

are called linearly convergent if < \p\ < 1, logarithmically convergent for p = 1 and hyper- 
linearly convergent for p = 0. For |p| > 1, the sequence diverges. 
A sequence ^Un^ accelerates a sequence ^Vn^ to s if 

lim {un - s)/(«„ - s) = . (29) 

If fwriS' converges to s then wc also say that -^WnS' converges faster than -S^Unj^. 
A sequence f Unl accelerates a sequence ^VnJ to s with order a > if 

{un - s)/{vn -s)= 0(n-") . (30) 

If \vn^ converges to s then we also say that -^Un J converges faster than ^Vn\ with order a. 

2.2.3 Operators 

Annihilation Operator: An operator A : — > K is called an annihilation operator for 
a given sequence ^Tn^ if it satisfies 

AiiSn + Ztn}) = AiiSn}) + zAiitn}) for all iSn} G §^ , {tr^} G S"^ , Z G K 

A{M) = o ^ ' 

Forward Difference Operator: 

Am5(m) = g{m + 1) - g{m) , A^gm = 9m+i - 9m 

A fe _ A Afc-1 

A A„ (32) 
A'=5„ = ^(-l)'=-^(^)5.+i 

Generalized Difference Operator vl^^ for given quantities ^ 0: 

VW = (^W)-iA (33) 

Generalized Difference Operator for given quantities Qn^ ^ 0: 

Vi'=) = (d'^)-^A2 (34) 

Generalized Difference Operator V"^'' for given quantities ^ 0: 

V (f)[a]/„ = (A«)-i(/„+2 - 2cosa/„+i + /„) (35) 

Generalized Difference Operator for given quantities A^'^' ^ 0: 

^i'^' [C]/n = (A«)-l(Ci'j,/„+2 + + C Jn) (36) 
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Weighted Difference Operators for given P^'' g P'^ ^: 

W^^fe) = >v(f'[p('="^'] = A''P^''-^\n) (37) 

Polynomial Operators Vior given P^*"^ e P''': Let P('^')(.t) = Ej=o pf^^;-'- Tlien put 

A; 



(38) 



Divided Difference Operator: For given -^lXh^ and e Nq, put 



i=0 



=0 *^n+z 



3=0 



(39) 



3 Some Basic Sequence Transformations 
3.1 E Algorithm 



Putting for sequences ^yn^ and ^gj{n)J, j = 1, 



Vn 

9k{n) 



Un+k 

gi (n + k) 
9k{n + k) 



(40) 



one may define the sequence transformation 



Ei'\m-:{{9,{nm 



(41) 



As is plain using Cramer's rule, we have El'"''(-Ja„§) = if the cr„ satisfy Eq. (|lo|). Thus, the 
sequence transformation yields the limit a exactly for model sequences (|lO|). 

The sequence transformation E is known as the E algorithm or also as Brczinski-Havie- 
Protocol |102, Sec. 10] after two of its main investigators, Havie |32| and Brezinski ||]. A good 
introduction to this transformation is also given in the book of Brezinski and Redivo Zaglia 
|l|, Sec. 2.1]. Compare also Ref. ||. 

Numerically, the computation of the Ei^\^Sn^) can be performed recursively using either 
the algorithm of Brezinski p. 58f| 



E 



■ 9k~i,k 



(n+l) _ (n) 
9k-l.k 9k-l,k 



(n+l) _ (n) 
(n) _ (n) 9k-lA 9k-l,i (n) 

9k,i —9k-lA~ (n+l) (n) '5fe_l,fcj 
9k-l,k ~ 9k-l,k 



k+l,k + 2, 



(42) 



or the algorithm of Ford and Sidi [p2[ that requires additionally the quantities gk+i{n + j), 

€\{{Sn] 



j = 0, . . . , fc for the computation of E„ 
quantities 

^C'fc,„(w) 



The algorithm of Ford and Sidi involves the 



E'^n\iUn}yA{gAn) 



lk+1 



in)higAn) 



(43) 
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for any sequence ^uo, mi, . . .J where the gi(n) are not changed even if they depend on the Un 
and the m„ are changed. Then we have 

= (44) 

and the ^' are calculated recursively via 

^k-l,n+l[gk+l) — ^ k-l,n[9k+l) 

Of course, for gj{n) — ujnipj-ii'n')j i-e., in the context of sequences modelled via the expan- 
sion (H), the E algorithm may be used to obtain an explicit representation for any Levin- type 
sequence transformation of the form (compare Eq. (^) 

^n^ = T{Sn, Sn+k;(^n, (^n+k', 1p]{n), . . . , l/'j (^^ + k)) (46) 

as ratio of two determinants 

£;l'=)[SiMJ;S^.-i(")S] ' 



This follows from the identity jl^ 

that is an easy consequence of usual algebraic manipulations of determinants. 



(48) 



3.2 The d^"^^ transformations 

As noted in the introduction, the d'™' transformations were introduced by Levin and Sidi 

as a generalization of the u variant of the Levin transformation [s^ ]. We describe a slightly 

modified variant of the S^™^ transformations [ [77| : 

Let Sr, r = 0, 1, . . . be a real or complex sequence with limit or antilimit s and terms 
Co = So and Or = Sr — Sr-i, T — 1,2,... such that Sr = X]r=o "^i' ^ ~ 0, 1, . . .. For given 
TO G N and ^; G No with / G No and < ^o < "^i < C2 < • • • and v ~ (rti, . . . ,n„i) with 



n 



G No the S™^ transformation yields a table of approximations si™'"''' for the (anti-)limit s 



as solution of the linear system of equations 



rifc 



fe=l 1=0 '^'^ 

with a > 0, = X^fcLi "fc an.d the iV -I- 1 unknowns s^J"'"''' and The [A'^Oj] are defined 
via [A^flj] = flj and [A'^Cj] = ajj^-\\ — \I^~'^aj\^ A; = 1,2, . . .. In most cases, all ri^ are 

chosen equal and one puts i> ~ (n,n, . . . ,n). Apart from the value of a, only the input of m 
and of is required from the user. As transformed sequence, often one chooses the elements 
^IrT'^^n) ^'^^ ^ ~ 0, 1, . . .. The u variant of the Levin transformation is obtained for m = 1, 
a = f3 and — I. The definition above differs slightly from the original one and was given 
in Ref. ^ with a = 1. 

Ford and Sidi have shown, how these transformations can be calculated recursively with 



the W^") algorithms pi. The d^™) transformations are the best known special cases of the 
generalised Richardson Extrapolation process (GREP) as defined by Sidi @^,|7|]. 

The d'™) transformations are derived by asymptotic analysis of the remainders s^ — s for 
r ^ 00 for the family _b(™) of sequences ^Or^ as defined in Ref. |^^. For such sequences, the 
Qr satisfy a difference equation of order m of the form 

m 

ar = ^Pk{r)A'' ar . (50) 

k=l 
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The pk {r) satisfy the asymptotic relation 



Pk{r) ~ r^'' ^ — ^ for r ^ oo . (51) 

e=o ^ 

The ik are integers satisfying ik 1^ k for fc = 1, . . . , m. This family of sequences is very large. 
But still, Levin and Sidi could prove Theorem 2] that under mild additional assumptions, 
the remainders for such sequences satisfy 

-s-^H'=(A'=~ia,)^^ forr^oo. (52) 

k=l i=0 ^ 

The jk are integers satisfying jk < k for fc = 1, . . . , m. A corresponding result for m — I was 
proven by Sidi |7ll, Theorem 6.1]. 

The system ( p9|) now is obtained by truncation of the expansions at £ = Un, evaluation at 
r = ^i, and some further obvious substitutions. 

The introduction of suitable was shown to improve the accuracy and stability in difficult 
situations considerably ||77[|. 



3.3 Shanks Transformation and Epsilon Algorithm 

An important special case of the E algorithm is the choice gj{n) — Asn+j-i leading to the 
Shanks transformation 

e.(.„)^^S^f^M^f^ (53) 



-ij 



(") _ A (") _ 

(") , 1 /r ("+i) 



Instead of using one of the recursive schemes for the E algorithms, the Shanks transformation 
may be implemented using the epsilon algorithm |104] that is defined by the recursive scheme 

^ 

Cfe+i = Cfe-i ' + l/fffe ■ ' - e/c J ■ 
The relations 

4fe^ = efc(s„) , e^^^_^i = l/efe(As„) (55) 

(n) 

hold and show that the elements e2fe+i only auxiliary quantities. 

The kernel of the Shanks transformation is given by sequences of the form 

fe-i 

Sn = S + ^ Cj ASn+j ■ (56) 

See also Q, Theorem 2.18]. 

Additionally, one can use the Shanks transformation — and hence the epsilon algorithm 
— to compute the upper half of the Pade table according to 104] 

CkiMz)) ^ [n + k / k]f (z) , (fc>0,n>0). (57) 

where 

n 

Mz) = Y.c,zJ (58) 

j=o 

are the partial sums of a power series of a function f{z). Pade approximants of f{z) are 
rational functions in z given as ratio of two polynomials pe e P*-^^ and G p(™) according to 

[£/m]f{z) = pfXz) I q„,{z), (59) 

where the Taylor series of / and [t/m]f are identical to the highest possible power of 2, i.e. 

f{z) ~ p,{z)/qUz) = 0(z^+™+l). (60) 

Methods for the extrapolation of power series will be treated later. 
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3.4 Aitken Process 

The special case ej"'' — ei(s„) is identical to the famous method of Aitken 



s(i) - s 



Sn+2 — 2Sn+l + S,i 



with kernel 



Sn = s + c{s„+i - s„), n g No . 



Iteration of the method yields the iterated Aitken process ^ 



102 1 



A(fc+1) - A(fc) _ \-^n+l ) 



(61) 
(62) 

(63) 



(fe) 

'-ri+2 



2A 



(k) 

n+l 



Ati 



(fe) 



The iterated Aitken process and the epsilon algorithm accelerate linear convergence and can 
sometimes be applied successfully for the summation of alternating divergent series. 

3.5 Overholt Process 

The Overholt process is defined by the recursive scheme |64] 



v\^\M) - (A.„+fe)'=Fr')(s.„s) 



(64) 



(As„+fc-i)*-^ - (As„+i;)'= 
for fc G N and n G Nq. It is important for the convergence acceleration of fixed point iterations. 



4 Levin- Type Sequence Transformations 
4.1 Definitions for Levin- Type Transformations 

A set AC") = {A^*"] e K I n e No , < j < fc} is called a coefficient set of order k with /c e N if 

A^''^ ^ for aU neNo- Also, A = {A^^) | fc e N} is called coefficient set. Two coefficient sets 

A — {{A^'^]}} and A {{A^'^]}} are called equivalent, if for all n and fc, there is a constant 

cl''^ ^ such that A^^;] = c'n hl^l for all j with < j < fc. 

For each coefficient set A'^'''^ = {^l^'j | G No, < j < fc} of order fc, one may define a 
Levin- Type sequence transformation of order fc by 



with 



(fe) Sn+j 

-_o 

ri^Hpn}, M) - '-^ (66) 

(fe) i_ 



and 



Y'"-'^ = {{M} e O*^ : ^ ^ni/^n+j + for all n e No} (67) 

3=0 

We call r[A] = {T[A'-''^ | fc e N} the Levin-type sequence transformation corresponding 
to the coefficient set A = {A^'') | fc e N}. We write T^*^) and T instead of T[A('=)] and 
T[A], respectively, whenever the coefficients X^^^, are clear from the context. Also, if two 
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coefficient sets A and A are equivalent, they give rise to the same sequence transformation, 
i.e., T[A] = T[A], since 



k k 

(k) Sn+j \ " \(fc) Sn+j 



with arbitrary cl'^'' 7^ 



forAi';J.=cWAW (68) 



j=0 •' j=0 



The number T„ are often arranged in a two-dimensional table 







T-(2) 



1 


1 


^ 1 


2 


r(i) 
2 


2 



(69) 



that is called the T table. The transformations T^''^ thus correspond to columns, i.e., to 
following vertical paths in the table. The numerators and denominators such that tL'^'' = 
Ni^^/D'n^ also are often arranged in analogous N and D tables. 
Note that for fixed N, one may also define a transformation 

r^:Ss„+^S^rt^|-^. (70) 

This corresponds to horizontal paths in the T table. These are sometimes called diagonals, 
because rearranging the table in such a way that elements with constant values of n + A; are 
members of the same row, T^^' for fixed N correspond to diagonals of the rearranged table. 
For a given coefficient set A define the moduli by 



max! A:,':n (71) 



o<i<fc ' "'-^ 



and the characteristic polynomials by 



nWeP'^ : nW(z) = EAS^^" (72) 



for n e No and fc e N. 

Then, T[A] is said to be in normalized form if /i,^^ = 1 for all /c G N and n G Nq. Is is said 
to be in subnormalized form if for all A: G N there is a constant /z^*"'' such that ^Ln^ < Jl^'"') for 
all n G No. 

Any Levin-type sequence transformation T[A] can rewritten in normalized form. To see 
this, use 

cl'=) = l/t^i'^ (73) 



in Eq. (pS]). Similarly, each Levin-type sequence transformation can be rewritten in (many 
different) subnormalized forms. 

A Levin-type sequence transformation of order k is said to be convex if U'k\l) = for 
all n in No. Equivalently, it is convex if ^ Y^''\ i.e., if the transformation vanishes 
for fsnj = fcwnj, c G K. Also, T[A] is called convex, if T[A('')] is convex for all A: G N. 
We will see that this property is important for ensuring convergence acceleration for linearly 
convergent sequences. 

A given Levin-type transformation T can also be rewritten as 

k 

Ti^\MAWn})^Y.^i'^A^n)Sn+,, J,, = (c.„ , . . . , C.„+fc) , (74) 

J=0 
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with 



,(k) 



k Ak) 



Then, one may define stability indices by 



ri'='m = EKi(-n)i>i 

J=0 



Note that any sequence transformation Q 



(75) 



(76) 



3=0 



with 



J=0 



= 1 



(77) 



(78) 



can formally be rewritten as a Levin-type sequence transformation according to Qn 
Tn\i^Sn^ , l^nl) with coefRcients A^'^] = Un+jqnjPri^ where the validity of Eq. (^ requires 
to set 

k 

pi'^=E^S/^"+^- (79) 

j=o 

If for given fc £ N and for a transformation T[A''''''] the following limits exist and have the 
values 



(80) 



for all < j < fc, and if A'*^) is a coefficient set of order k which means that at least the limit 



A), docs not vanish, then a limiting transformation 7|A'^'^)] exists where A^*^^ — {X - }. More 
explicitly, we have 



with 



and 



^(fc) Sn+j 

E^f- 



3=0 



n+3 



Y^k) ^ 11^^^ e O"^ : ^ Af V'^n+j ^ for all n e No} . 



(81) 



(82) 



(83) 



Obviously, this limiting transformation itself is a Levin-type sequence transformation and 
automatically is given in subnormalized form. 



4.1.1 Variants of Levin- Type Transformations 

For the following, assume that /3 > is an arbitrary constant, an — As„_i, and a„ are 
Kummer-related to the a„ with limit or antilimit s (cp. Section 2.2.1). 

A variant of a Levin- Type sequence transformation T is obtained by a particular choice 
LOn- For LOn = fn{\sn^), the transformation T is nonlinear in the s„. In particular, we have 
l5q,p3|,^: 
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t Variant 

*..„ = A.„_i=a„ : *rW(Ss„S) = fc^„}}) (84) 

u Variant 

= (n + /3)As„_i = (n + /3)a„ : "T^ ^s,,}}) = Ti^Hl-Sn}, T^nJ) (85) 

V Variant 

V. = = : ^TW({{-a) = rW(S-4}, r-4}) (86) 

A^s„_i a„ - a„+i 



t Variant 



It Variant 



lu Variant 



Iv Variant 



It Variant 



K Variant 



*u;„ = As„ = a„+i : 'Tl^Hpn}) = ri'\M, {{Vj) (87) 
= a„ : '*T('=)({{,s„S) - rW(Ss4}, S"^nS) (88) 
'"c^„ = (n + /3)a„ : '"T(f)(/3, = Ti'^^d.^, (89) 



^ : '^Ti^)ils^}) = rW(|.,J,S'^'c.„}) (90) 

"n ~ "n+l 



K 



^„ = 5„ - s : ^r«(|:sa) = rW({{.„}}, S^..„:&) (92) 
The K variant of a Levin- type transformation T is linear in the s„. This holds also for the It, 
lu, Iv and It variants. 

4.2 Important Examples of Levin- Type Sequence Transformations 

In this section, we present important Levin-type sequence transformations. For each trans- 
formation, we give the definition, recursive algorithms and some background information. 

4.2.1 J' Transformation 

The J7 transformation was derived and studied by Homeier[||,|^,|3|-|o[|6|. Although the J 
transformation was derived by hierarchically consistent iteration of the simple transformation 

s'n = - (93) 

it was possible to derive an explicit formula for its kernel as is discussed lated. It may be 
defined via the recursive scheme 

iV« = Vl'=-i)7Vl'^-i) , = V(f-i)i5('="i) , (94) 

where the generalized difference operator defined in Eq. (^) involves quantities ^i*"^ ^ for 
G No- Special cases of the J' transformation result from corresponding choices of the Sn ■ 
These are summarized in Table ^ 

Using generalized difference operators V^f' , we also have the representation Eq. (38)] 

^(fc-l)^(fc-2) „(0)r / 1 

Vn Vn . ■ • Vn [i/ti'rij 
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Table 1: Special cases of the J transformation ^ 



Case 



V'j (n) ' 



Drummond transformation 
Homeier J. transformation 



= J 



(2k), 



Homeier T transformation 



Homeier pJ transformation 
Levin transformation 
generalized C transformation 
Levin-Sidi d*^^-* transformation 

Slip 

Mosig-Michalski algorithm 

Sidi W algorithm 
(GREP'^') |f|,0,|7| 

Weniger C transformation 
C?'(7,/9/7,fisn|,«^nJ) 
Weniger transformation 

Weniger 5 transformation 

Iterated Aitken process 



= ^i"(«Sn8,SAs„J,{5W}) 
Overholt process 



Eq. (231) 



l/(a;„)j 



Eq. ( [23 1| ) 

(Rn+a)' 



S^^^ = exp(2iQn) , 
= exp(-2ian) Ai* > 

(xj + fc)(a::.,+fc+i + fc - 1) 
Xn + k -1 j-J-^ {xj + fc - l)(2:j+fc+2 + fc) 



1 



{n + P+{p-l)k)2 
1 

(n + /3)(n + /3 + fc + 1) 

(n + /3 + fc + l)"-(n + /3)" 
(n + /3)"(n + /3 + fc + l)" 



-Rn + fc + l + Q Rn + CC 



Eq. (231) 



(7n + (5), 
1 

i-n - 
l/(n + /?),- 



(n + l + (/3 + fc-l)/7)fc 
(rz + (/3 + fc)/7)fe+2 

(n + l+C-(fc~l))fc 
{n + ^ - k)k+2 

1 



Eq. (231) 



(n + /3 + 2fc)2 



(AAi''+'>(|s„|))(A"A^'°0(gg. 
(AAi'=)(«.a))(AAi^:),(S.„| 



2 A('=)^ 



Eq. ( |231| ) 



(A5„+fc+i)A [(As„+0''+i] 
(As„+fc)'=+i 



t Refs. |||,|38|0. For the definition of the t/)j,„ see Eq. @. Factors independent of n are 
irrelevant. 
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The J transformation may also be computed using the alternative recursive schemes [ p6| , 
^(fc) ^ 1) iviy ) - iV,^- 1) , keN, (96) 



2+1 



with 



and 



"n+l"n+l ' ' ' "n+1 

N^n^ = ^i+Y' - ^'■t^^N^t'^ , A; G N , (98) 



with 



j(o) j(i) ...j(fc-i) 

( 

The quantities '^''n^ should not be mixed up with the '^k,n{u) as defined in Eq. (p3|). 

As shown in [Q, the coefhcients for the algorithm (^) that are defined 
Si^o ^n^/^n+j, satisfy the recursion 

Ai':r^ = 'J>1'=^A«,„_, - Ag (100) 

with starting values A^"^- = 1. This holds for all j if we define A|f] = for j < or j > k. 

Because $1'°'' ^ 0, we have A^'^^ ^ such that {A^f^} is a coefhcient set for all k £ Nq. 

Similarly, the coefficients for the algorithm ( p8|) that are defined via D^i^ — J2'j=o ^ii] /^n+j , 
satisfy the recursion 

ASr^-A^i.-i-^i'^^Ag (101) 

with starting values A„ ^- = 1. This holds for all j if we define A„ j = for j < or j > k. In 

this case, we have A^*^^ = 1 such that {A|f]} is a coefficient set for all k G Nq. 

Since the J transformation vanishes for ^Sn^ — ^aun^, c G K according to Eq. (|95| ) for 
all A: G N, it is convex. This may also be shown by using induction in k using A^^^j^ = "A^^g — 1 
and the equation 

J=0 j=0 j=0 



^(0) _ -, ^(fc) _ n+k n+k-1 n+1 fc G N (99) 



that follows from Eq. (|100|). 

Assuming that the limits $fc = lim„^oo $1*''' exist for all A: G N and noting that for fc = 

o o 

always $o = 1 holds, it follows that there exists a limiting transformation J[I^ that can be 
considered as special variant of the transformation and with coefficients given explicitly as 
H, Eq. (16)] 

lik) _ (_,\k-j 



j 

As characteristic polynomial we obtain 



jo+il + ---+ik~l=i- m=0 



fc fc-1 

n('=)(^) = E = W'^^ ^ - 1) ■ (104) 

j=0 j=0 
o o 

Hence, the JT^ transformation is convex since n('=)(l) = due to $0 = 1- 
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The pj Transformation. This is the special case of the jrtransformatioii corresponding to 

1 



or to g Eq. (18)][] 



( fn+P+2 



(105) 



or to 



(fc) 



p-1 

n + P + 2 
n + (3 

n + jS + k- 1 
n + i3 + k-l 



n + (3 



for p ^ 1 



(106) 



for p = 1 



n + jS + k+l 



for p / 2 



for p = 2 



that is, 



+ f3 + k + l^ 

(/?, isn}}, M) - ji^HpnJ, M, {l/{n + (3+{p- l)fc)2}) 



(107) 



(108) 



The Umiting transformation j, J of the p J transformation exists for all p and corresponds 

o 

to the J7 transformation with $fc — 1 for all fc in Nq. This is exactly the Drummond transfor- 
mation discussed in Section 4.2.2, i.e., we have 



p Jl'^(/3, M) = v^^HM, M) . 



(109) 



4.2.2 Drummond Transformation 



This transformation was given by Drummond ||T^. It was also discussed by Weniger |8^]. It 
may be defined as 

T^i'\MA^n}) = ^^^ (110) 

Using the definition ( ^2|) of the forward difference operator, the coefficients may be taken as 



A^''^- = i-iy 

71, J \ / 



(111) 



i.e., independent of n. As moduli, one has ^1*^'' = (fj,/2i) = m'-'^-'- Consequently, the Drummond 



transformation is given in subnormalized form. As characteristic polynomial we obtain 

^k 



n«(z) = 5:(-i)^r z^ = (i-z)^ 

j=0 ^-^^ 



(112) 



Hence, the Drummond transformation is convex since Wn '{l) = 0. Interestingly, the Dr um- 

(113) 



mond transformation is identical to its limiting transformation: 
The Drummond transformation may be computed using the recursive scheme 



2)W = TVi'^V^i'^ ■ 



(114) 



^The equation in p6| contains an error. 
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4.2.3 Levin Transformation 



This transformation was given by Levin |Q. It was also discussed by Weniger |Q. It may 
be defined a^ 



r('^)(RS IX XX^ (n + /3 + fc)i-''Afe[(n + /?)'-ig„/c.„] 



Using the definition ( p2|) of the forward difference operator, the coefficients may be taken as 



^n j = (-IF (^■. j in + P + jY-'lin + P + kr-' , (116) 

The moduli satisfy nit^ < (n;/2]) — ^'^^ given k. Consequently, the Levin transformation 
is given in subnormalized form. As characteristic polynomial we obtain 

n^fH^) = J2(-^y (^) ^'('^ + ^ + ^■)''V(" + /3 + fc)'"' (117) 

j=o ^-^^ 

Since II^'^^l) because A*^"^ annihilates any polynomial in n with degree less than k, the 
Levin transformation is convex. The limiting transformation is identical to the Drummond 
transformation 

^^'^ iM, M) = vi'^ ({{.„ J, M) . (118) 

The Levin transformation may be computed using the recursive scheme ||,|||8|, Q 
Sec. 2.7] 

iV(J" = sju^ , = l/^„ , 

= /v(^-i) (/? + »)(/3 + ^ + fc-l)''^ ,,(fe-i) 

pC/c) _ p(A-i) (0 + ^)(/? + n + fc - 1)^-^ ^ 

" ~ "+i (/3 + „ + fc)fc-i 

4'^(/?,S^n}},Sc.„}}) = 7VW/Z?W 

This is essentially the same as the recursive scheme ( p^ ) for the ^7 transformation with 

_ (/3 + n)(/? + n + fc)^-i 

(/3 + n + fc + 1)^ " ^ ^ 

since the Levin transformation is a special case of the J transformation (see Table Thus, 
the Levin transformation can also be computed recursively using the scheme ( p^ 

A(fc) ^ i ('1211 

(n + /3)(n + /3 + fc+l) ' ^ ^ 



or the scheme ( p6| ) with [|6| 

(122) 



4.2.4 Weniger Transformations 

Weniger [^,|8^, ^ derived sequence transformations related to factorial series. These may 
be regarded as special cases of the transformation 

((a[rt + C + fcj)fc-i) '-A'^[[a[n + Q)k-i/iOn\ 
In particular, the Weniger S transformation may be defined as 

Sj'HP, PnJ, M) ^ Cj^Hl, P, Pn}, M) (124) 

^Note that the order of indices is different from that in the Uterature. 
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and the Weniger Ai transformation as 



Mi'^ is,,}}, M) C« (-1, t M) . (125) 

The parameters (3, ^, and C are taken to be positive real numbers. Weniger considered the C 
transformation only for a > [^,|8^ and thus, he was not considering the A4 transformation 
as a special case of the C transformation. He also found that one should choose ^ > fc — 1. 
In the u variant of the M transformation he proposed to choose w„ — (— n — ^)As„_i. This 
variant is denoted as "A^ transformation in the present work. 

Using the definition ( ^^ of the forward difference operator, the coefficients may be taken 

as 

aS - (-1)^' {a[n + C + j])k^i/{a[n + ( + fc]),_i (126) 
in the case of the C transformation, as 

Ag- - (-1)^' {n + p + j)k-i/{n + P + k),_, (127) 

in the case of the S transformation, and as 



aS- = (-1)^ ]i-n~^- 3)k-i/{~n - e - k)u^i (128) 



in the case of the M transformation. 



The S transformation in (124) may be computed using the recursive scheme ( |98[ ) with [ p4| . 
Sec. 8.3] 

* W ^ {P + n + k){P + n + k-l) 

{l3 + n + 2k){l3 + n + 2k-l) ^ ' 



The M. transformation in ( |l25| ) may be computed using the recursive scheme (98) with 
Sec. 9.3] 

^'n' = ^ + "''+! (130) 



The C transformation in (123) may be computed using the recursive scheme (^8|) with 
Eq. (3.3)] 

= (o[c + .] + - 2) ("["+ir!.n'""^ (131) 

{a[n + C + k\)k^i 

Since the operator A'^ for fc e N annihilates all polynomials in n of degree smaller than 
fc, the transformations S, A4, and C are convex. The moduli satisfy /ii'^'' < (|j,/2]) ~ ^^'^^ 
given k. Consequently, the three Weniger transformations are given in subnormalized form. 

For a — > oo, the Levin transformation is obtained from the C transformation ^T\ . The S 
transformation is identical to the 3J transformation. It is also the special + /3 of 

the J- transformation. Analogously, the C transformation is obtained for Xn = a[C, + n]. All 
these Weniger transformations are special cases of the J' transformation (compare Table ||). 

The limiting transformation of all these Weniger transformations is the Drummond trans- 
formation. 



4.2.5 Levin-Sidi Transformations and W Algorithms 



As noted above in Section 3^, the d'™^ transformations were introduced by Levin and Sidi 
as a generalization of the u variant of the Levin transformation, and these transformations 
may be implemented recursively using the W^™-' algorithms. 

The case m = 1 corresponding to the d^^^ transformation and the W^^^ — W algorithm is 
relevant for the present survey of Levin-type transformations. In the following, the fc-th order 
transformation T'^'"'^ of Levin-type transformation Tas given by the W algorithm is denoted 
by l^^C^) which should not be confused with the W*^™^ algorithms of Ford and Sidi jp^ . 

The W algorithm [|| was also studied by other authors [||, Sec. 7.4], |l|, p. 71f, 116f] 
and may be regarded as a special case of the J transformation [B6|. It may be defined as 
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(compare j?^, Theorems 1.1 and 1.2]) 



juio) ^ ^ r)(o) ^ J_ 



and computes 



tn+k - in ' (132) 

tn+k in 

W^i'=)(S-nS, S-nl, {{tn}}) = ^^^^f^ (133) 

□k^(l/w„) 

where the divided difference operators oii^ = oii\^tn'^] are used. The W algorithm may 
be used to calculate the Levin transformation on putting i„ = l/{n + P). Some authors call 
a linear variant of the W algorithm with u;„ = (— l)"+^e~"^''<^ the W transformation, while 
the t variant of the W algorithm (tJ, ^ is sometimes called mW transformation |57|, |60| . 

o 

If tn+i/tn — > T for large n, one obtains as limiting transformation the JT^ transformation 
with $j = r^-* and characteristic polynomial 

o 

nW(2) ^ _ 1) . (134) 

For the transformation, we write 

{d^'^)^n\c., {{in}) = W^^Hlsa. i{in + «)(5?„ " S^^_,)}, Sl/(C„ + «)}}) (135) 

Thus, it corresponds to the variant of the W algorithm with remainder estimates chosen as 
{in + ct){s^„ — s^n-i) operating on the subsequence Ss4„S' of \^n\ with i„ = l/(^„ + a). It 
should be noted that this is not(!) identical to the u variant 

"-w^nKha. + c^m = w^^\isa. + «)S) , (i36) 

neither for "w„ = (n + a){s^^ — s^^_^) nor for " cj^ = (^„ + a){s^^^ — s^„_i), since the remain- 



der estimates are chosen differently in Eq. (135) 



The d*'^-' transformation was thoroughly analyzed by Sidi (See (T^jQ and references 
therein) . 

4.2.6 Mosig-Michalski Transformation 

The Mosig-Michalski transformation — also known as "weighted-averages algorithm" — was 
introduced by Mosig ||6^ and modified later by Michalski who gave the t variant of the 
transformation the name K, transformation (that is used for a different transformation in 
the present article(!)), and applied it to the computation of Sommerfeld integrals [ |60| . 
The Mosig-Michalski transformation M may be defined via the recursive scheme 

^n — ^n 1 

(k) (k) (k) 

(fe+1) _ g„ -h77„ 

Mi'\iSn},{{iUn},l^n})^si'^ 

for n G No and fc € No where -8^a;„S- is an auxiliary sequence with lim„^oo ^/Xn = such that 
Xn+e > Xn for £ € N and xo > 1, i.e., a diverging sequence of monotonously increasing positive 
numbers, and 



2k 

e) = -^f^) . (138) 

^n+l 
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Putting Loii'' = ujn/x^, Nn'' = Sn'' /oJn \ and Dn'' — l/uj^n \ it is easily seen that the recursive 
scheme (137) is equivalent to the scheme (|9^) with 

± 



€^ - ^ ( 1 - 5^ ) • (139) 



Thus, the Mosig-Michalski transformation is a special case of the transformation. Its 
character as a Levin-type transformation is somewhat formal since the On and, hence, the 
coefficients A^''] depend on the w„. 

If Xn+i/xn ^ ^ > 1 for large n, then a limiting transformation exists, namely 

o 

M{fsnJ, fi^nj: {{C"^^}})- K corrcspouds to the J" transformation with $fe — ^'^'^ . This may 
be seen by putting d[':^ = l/tJ„, ivi''' = s^n^ D^n'^ and ^^n'^ = in Eq. (H). 

4.2.7 J- Transformation 

This transformation is seemingly new. It will be derived in a later section. It may be defined 
as 

where l^a;^^ is an auxiliary sequence with lim„^oo \/xn — such that Xn+i > Xn for ^ e N 
and a^o > 1) i-e., a diverging sequence of monotonously increasing positive numbers. Using 
the definition ( p^ ) of the divided difference operator □^'^^ = □^'^^[■^a;„§], the coefficients may 
be taken as 

Ag ^ (^"+^)fe-i fl ^ ^ j| x„+, +m f^^Yl _ ^ . (141) 

Assuming that the following limit exists such that 

lim ^ = ^ > 1 (142) 

n-+oo a;„ 

o 

holds, we see that one can define a limiting transformation ^C^' with coefficients 



7 -.-i-i-i-i '"n.7 /-'i 



Since 

k-2 , / X fc fc 



TT + [ ^" j TT ^ , ^(fe-ib-^*=(-j) TT 



(144) 



for n ^ cxD. Thus, the limiting transformation is given by 

E 'Sn+j TT 1 

>)(fs„}},|c.a,0 = V ^ f ^ • (145) 

Comparison with the definition (^^ of the divided difference operators reveals that the limiting 
transformation can be rewritten as 

' •&W„S, C) = — — • (146) 
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Comparison to Eq. (133) shows that the hmiting transformation is nothing but the W algo- 
rithm for tn = As characteristic polynomial we obtain 



1 



(147) 



3=0 



The last equality is easily proved by induction. Hence, the transformation is convex since 

n('=)(i) = 0. 

As shown in Appendix the transformation may be computed using the recursive 
scheme 



1 1 



{xn+k + k~ 2)iviy > - (x„ + fc - 2)Ni^-^^ 
{x„+k + k- 2)i?iy ^ - + - 2)^1''"'^ 



(148) 



•1+1 



It follows directly from Eq. (146) and the recursion relation for divided differences that 
the limiting transformation can be computed via the recursive scheme 



" (fe-1) 



^ * n 



D 



(k-i) 

n+l 



(fe-1) 



(149) 



4.2.8 Transformation 



This transformation is newly introduced in this article. In Section 5.2.1, it is derived via 
(asymptotically) hierarchically consistent iteration of the P^^-* transformation, i.e., of 



, _ A^(s„/a;„) 
A2(l/c.„) ■ 

The transformation may be defined via the recursive scheme 

Ar(k) ^ y(fe-l) Afik-l) r)(fe) ^ y(fe-l) r)(fe-l) 



(150) 



(151) 



where the generalized difference operator defined in Eq. ( ^ ) involves quantities c}n^ ^ for 
/c G Nq. Sp ecia l cases of the JV transformation result from corresponding choices of the C^n'^ . 
From Eq. (151) one easily obtains the alternative representation 



^{k-l)^(k-2) 
V n V n 



7(0) 



vr^)vr^)...v(°)[i/^„] 



(152) 



Thus, the JX>('=' is a Levin-type sequence transformation of order 2k. 



4.2.9 H Transformation and Generalized H Transformation 

The 7i transformation was introduced by Homeier |]3^ and used or studied in a series of 
articles [^|4l|-^, 63|. Target of the 7i transformation are Fourier series 



s = ylo/2 + ^{Aj cos(ja) -I- Bj sin(ja)) 
j=i 



(153) 
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with partial sums s„ = Ao/2 + X]J=i {^j cos(ja) + Bj sin(jQ;)) where the Fourier coefRcients 
A„ and i?„ have asymptotic expansions of the form 



Cn 



3=0 



(154) 



for n ^ Qo with p G K, e G K and cq ^ 0. 

The Ti transformation was critized by Sidi as very unstable and useless near singu- 
larities of the Fourier series. However, Sidi failed to notice that — as in the case of the 
transformation with — th — one can apply also the Ti. transformation (and also most other 
Levin-type sequence transformations) to the subsequence -^^s^^^ of -fsnS"- The new sequence 
elements s^^ — s^n can be regarded as the partial sums of a Fourier series with r-fold fre- 
quency. Using this r-fold frequency approach, one can obtain stable and accurate convergence 
acceleration even in the vicinity of singularities ^^-JiJ] . 

The Ti. transformation may be defined as 

Nl°^ ={n + sn/^n , Dl°^ = {n + 13)-^^^ , 
7V,^) = (n + mi^-'^ + {n + 2k + 



-2cos(a)(n + fc + /3)A^|,'Vi^^ , 
) ={n + f3)Di'-'^ + {n + 2k + (3)d[^,'^ 
- 2 cos(a)(n + k + I3)d[^-^^'> , 

where cos a ^ ±1 and /3 G M+. 

It can also be represented in the explicit form pj] 



(155) 



7^W(a,/3,|s„l,M) 



P[p(2fc)(a)][(n-|-/3)fe-ig„/u;„] 
7'[P(2fe)(a)][(ri + /3)''^-Vc^„] 



where the pm''\ce) and the polynomial P(^'^^(a) G P^^*^) are defined via 



2k 



p(2'=)(a)(2;) = (x^ -2xcosa-f 1)'= = ^p(^'=)(a)a;" 



(156) 



(157) 



m=0 



and V is the polynomial operator defined in Eq. (^). This shows that the TY^'"') transformation 
is a Levin-type transformation of order 2k. It is not convex. 
A subnormalized form is 



E(2fc)(- ^ ('t + /3 -I- m)'' ^ Sn+m 
^"^(n + /3 + 2A:)'=-ic.„+™ 



2k 



(n + /3 + m) 



k-l 



(158) 



m=0 



(n + /? + 2kY-^ UJ.n+.m 



This relation shows that the limiting transformation 



P[P(2'^)(a)][l/a;„] 

exists, and has characteristic polynomial P'^'^^^{a). 

A generalized TL transformation was defined by Homeier 
the polynomial P^^^'^"\e) G P*''^'^) with 



(159) 



43 1 . It is given in terms of 



M 



kM 



m=l t=Q 

^'^ is a vector of constant parameters. Then, the generalized Ti 
p[p(M/)(e)][(„ + ;3)fc-is„/,^„ 



where e = (ei, . . . , ca/ ) G 



transformation is defined as 



77[p(fc,M)(e)][(„ + ^)/c-i/^^] 



(161) 
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This shows that the generahzed Ti^^'^') is a Levin-type sequence transformation of order kM. 
The generahzed Ti. transformation can be computed recursively using the scheme pO|,^^ 

N^n^ = {n + s„/c^„ , Di°^ = {n + /3)- Vc^„ , 

M 



j=o 

M 



(162) 



Here, the qj are defined by 

M M 

W{x - e„i) = ^ qjX^ . (163) 

m—l j—0 



The algorithm ( |l55| ) is a special case of the algorithm (162). To see this, one observes that 
M = 2, ei — exp(ia) und 62 — exp(— ia) imply qo — q2 — ^ and qi — — 2cos(q;). 
For M—l and ei = 1, the Levin transformation is recovered. 

4.2.10 T Transformation 

The T transformation was in a slightly different form introduced by Homeier ]35| . It was 
derived via (asymptotically) hierarchically consistent iteration of the 7i^^^ transformation, 
i.e., of 

^, _ S„+2/uJn+2 - 2cOs(a) Sn+i/uJn+l + Sn/^n ^j^g^^ 

" l/cj„+2 - 2cos(a)/LJ„+i + l/w„ 

For the derivation and an analysis of the properties of the J transformation see The 
I transformation may be defined via the recursive scheme 



where the generalized difference operator Vrf ^ [a] defined in Eq. (|5|) involves quantities A^'^^ ^ 
for k G Nq. Special cases of the I transformation result from corresponding choices of the 
A^'^'' . From Eq. ( |l65| ) one easily obtains the alternative representation 

(fe-l)r 1 (fe-2)r 1 (0)r ir / 1 

rWfff, U ff,, U /aWU - V» [a]Vn M...Vn [a][Sn/uJn] , . 

Thus, Z^'^) is a Levin-type sequence transformation of order 2k. It is not convex. 
Put ei? = 1 and for fc > define 

a(0) A(fc-l) 

Qi'') ^ ^" (167) 

^" .(0) , (fe-1) ■ 

^n+1 ■ • • 

If for all fc G N the limits 

lim e*^) = Ofe (168) 

n — !-oo 

o 

exist (we have always 0o = 1), then one can define a hmiting transformation Xfor large n. It 
is a special case of the X transformation according to Q| 

(a, M, M, iOk}) - li'^ (a, is,,}, iie,/e,+rn) . (169) 
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o 

This is a transformation of order 2k. The characteristic polynomials of lare known to be 

fc-i 

Q(2'=)(a) e P^*^ : Q(2'=)(a)(z) = H ~ expM)(l - zOj exp(-m))] . (170) 

3=0 

4.2.11 IC Transformation 

The IC transformation was introduced by Homeier ||37[| in a slightly different form. It was 
obtained via iteration of the simple transformation 

^(0) ^(1) ^"+1 _|_ ^(2) ■S»+2 



that is exact for sequences of the form 

Sn = S + LOnicPn + dQn) , (172) 

where c and d are arbitrary constants, while Pn and Qn are two linearly independent solutions 
of the three-term recurrence 

Ci^^vn + C^v„+i + C?)i;„+2 = . (173) 
The IC transformation may be defined via the recursive scheme 

Z?ri)=9W[C]Di'=), (174) 



where the generalized difference operator 9^*^ defined in Eq. ( p}6| ) involves recursion coef- 
ficients Clflfc with j = 0,1,2 and quantities A^'^'' ^ for fc G Nq. Special cases of the IC 
transformation for given recursion, i.e., for given Cn \ result from corresponding choices of the 



aI*^-*. From Eq. (174) one easily obtains the alternative representation 



A:Wfffs II i^uj II lA^i {(-(jHi = — [C]...9n [C]K/^»] ^ 

Thus, /CC^) is a Levin-type sequence transformation of order 2k. It is not convex. 
For applications of the IC transformation see p7|, ^^,|4^]. 



5 Methods for the Construction of Levin-Type Transfor- 
mations 

In this section, we discuss approaches for the construction of Levin-type sequence transforma- 
tions and point out the relation to their kernel. 

5.1 Model Sequences and Annihilation Operators 

As discussed in the introduction, the derivation of sequence transformations may be based 
on model sequences. These may be of the form (^0|) or of the form (||). Here, we consider 
model sequences of the latter type that involves remainder estimates a;„. As described in 



Section 3.1, determinantal representations for the corresponding sequence transformations 



can be derived using Cramer's rule, and one of the recursive schemes of the E algorithm 
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may be used for the computation. However, for important special choices of the functions 
'ipj{n), simpler recursive schemes and more explicit representations in the form (|l^) can be 
obtained using the annihilation operator approach of Weniger . This approach was also 
studied by Brezinski and Matos [T^ who showed that it leads to a unified derivation of many 
extrapolation algorithms and related devices and general results about their kernels. Further, 
we mention the work of Matos Q who analysed the approach further and derived a number 
of convergence acceleration results for Levin-type sequence transformations. 

In this approach, an annihilation operator A = A^t^ as defined in Eq. (^l]) is needed that 
annihilates the sequences ^iJj{n)^, i.e., such that 

Ai'HUj{nm = for.?=0,...,A;-l. (176) 

Rewriting Eq. in the form 

^=x:c.V',H, (177) 



and applying A to both sides of this equation, one sees that 



_^(.) ^ ^ U (178) 



This equation may be solved for a due to the linearity of A. The result is 

_ Ai^\ian/u;n}) 



A^'\{{1M) 



leading to a sequence transformation 



rW(S-,J,«-}}) = (180) 



Since A is linear, this transformation can be rewritten in the form (|ll|), i.e., a Levin- type 
transformation has been obtained. 

We note that this process can be reversed, that is, for each Levin-type sequence transfor- 
mation T[A('^^] of order k there is an annihilation operator, namely the polynomial operator 
-Pjnl^^] as defined in Eq. (H) where ni^'^ are the characteristic polynomials as defined in Eq. 
(72). Using this operator, the defining equation (|6^ ) can be rewritten as 

ri'HMAM) = (181) 
r[ui!:>]{i/u;n) 

Let (j)rt}n for m = 0, . . . , fc — 1 be fc linearly independent solutions of the linear (fc + l)-term 
recurrence 

k 

^Ai>„+,=0. (182) 

j=o 

Then V[Ilit''](l>i^}n = for m = 0, . . . ,fc — 1, i.e., 'P[Ilit''] is an annihilation operator for all 
solutions of Eq. (182). Thus, all sequences that are annihilated by this operator are linear 
combinations of the k sequences f'/'n'^Ll- 

If f (Tn S is a sequence in the kernel of T^''^ with (anti)limit cr, we must have 

a = ^1II|}(^ (183) 

or after some rearrangement using the linearity of V 

v[n(^n(^^]-0- (184) 
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Hence, we must have 

fc-i 



o-„ — cr _ 

" m=0 



fc-i 



or, equivalently 

cr„ = cr + CJ„ E c™(/i^';)„ , (186) 
m— 

for some constants Cm- Thus, we have determined the kernel of T^'''> that can also be considered 
as the set of model sequences for this transformation. Thus, we have proved the following 
theorem: 

(k) 

Theorem 1 Let (j)n,m for m = 0, . . . , fc — 1 be the k linearly independent solutions of the linear 



{k + \)-term recurrence m^ ). The kernel of T[K^^'^]{lsA,luJn}) is given by all sequences 



[cr„J with (anti)limit a and elements an of the form nlSq) for arbitrary constants c„ 

We note that the ipjin) for j = 0, . . . , A: — 1 can essentially be identified with the ^i'^]- 
Thus, we have determinantal representations for known 4'j{n) as noted above in the context 
of the E algorithm. See also for determinantal representations of the J transformations 
and the relation to its kernel. 

Examples of annihilation operators and the functions tj^j (n) that are annihilated are given 
in Table ^ Examples for the Levin-type sequence transformations that have been derived 
using the approach of model sequences are discussed in Secti on |5.1.2| . 

Note that the annihilation operators used by Weniger ^7|,^8{ were weighted difference 
operators wi''^ as defined in Eq. (^7|). Homeier |^,|3^,|9| discussed operator representations 
for the J transformation that are equivalent to many of the annihilation operators and related 
sequence transformations as given by Brezinski and Matos jl^ . The latter have been further 
discussed by Matos who considered among others Levin-type sequence transformations 
with constant coefficients, A^'^j = const., and with polynomial coefhcients X^^^j = Xjiji + 1), 
with Xj e P, and n G No, in particular annihilation operators of the form 

Liun) = {fl' + Xin'-^ + ... + A,)(u„) (187) 

with the special cases 

Li{un) = i^l - ai)(n - 02) ■ ■ ■ - ai){un) , {a^j^aj ior all i j , (188) 

and 

L2(u„) = (f7-a)'(u„) (189) 

where 

il^'{Un) = {n+ l)rUn+r , n G Nq (190) 

and ^ 

L{un) = (tt - ai)(7r - 02) • • ■ (tt - a;)(u„) (191) 

where 

Tr{un) = {n + l)Aun , ^"(u„) = 7r(7r'-i(w„)) , n G No (192) 

and the A's and a's are constants. Note that n is shifted in comparison to where the 
convention n € N was used. See also Table ^ for the corresponding annihilated functions 
V'j(n). 



Matos 59 1 also considered difference operators of the form 

L{u„) - A'^ + (n) A^-i + ---+PI (n) A + poin) (193) 

where the functions fj given by fj{t) = pj{l/t)t^^^^ for j = 0, . . . , fc — 1 are analytic in the 
neighborhood of 0. For such operators, there is no explicit formula for the functions that are 
annihilated. However, the asymptotic behavior of such functions is known |^,|59|. We will 
later return to such annihilation operators and state some convergence results. 
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Table 2: Examples of Annihilation Operators 



Type 



Operator 



,J = 0, . 



,k-l 



Differences 



Weighted Differences A'=(n + 

A'=(a[n + C]r 



1 



Divided Differences 



Polynomial 



A'=(a[n + C])fc-i 
7'[p('')](n + /3)" 



Li (see (|8|)) 
L2 (see ( |l89|) ) 



L (see (|T9TJ)) 



(n + py 

(n + (3) J 
(a[n + C]y 
(a[n + C])j 
Pj{n) ,pj e 

i/(n + py 

l/{n + (3), 
l/ia[n + C]y 
l/{a[n + C])j 

'"n 

p,(t„),p, GP(^' 

l/{Xn)j 

exp{+ian)pj{n) ,pj G 
exp(— zan)pj(n) ,pj G 
exp(+zQ!n) / {n + (3y 
exp(— ian) /{n + f3y 
exp(+iQ!n) / {n + 
exp(— zan) / {n + (3)j 
Tpj (n) is solution of 

k 

m=0 

(n + (3)™'ipj{n) is solution of 

k 

j2pi'\n+, = o 

m=0 



n 



.It" 

T{n + Qfj + 1) 



See also Section |5.1.2| . 



5.1.1 Derivation of the T Transformation 

As an example for the application of the annihilation operator approach, we derive the T 
transformation. Consider the model sequence 



1 



fc-i 



(194) 



that may be rewritten as 



fc-i 

J=0 



(195) 



We note that Eq. (194) corresponds to modeling /i„ = Rn/wn as a truncated factorial series 
in x„ (instead as a truncated power series as in the case of the W algorithm). The a;„ are 
elements of ■S^a:^^^' an auxiliary sequence Sa;„ J such that lim„^oo l/a;^ = and also Xn+i > a;„ 
for £ £ N and xq > 1, i.e., a diverging sequence of monotonously increasing positive numbers. 
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To find an annihilation operator for the tpjin) = l/(xn)j, we make use of the fact that the 
divided difference operator □1'^^ = □l'^^[§x„§] annihilates polynomials in x„ of degree less 
than k. Also, we observe that the definition of the Pochhammer symbols entails that 

(x„)fe_i/(x„)j = (x„ +j)k-i-j , (196) 

is a polynomial of degree less than k in x„ for < j < k — I. Thus, the sought annihilation 
operator is ^ = ol^\xn)k-i because 

□i'^ {Xn)k^l j\- = , < j < fc - 1 . (197) 



Hence, for the model sequence (194), one can calculate a via 



(198) 



and the transformation (140) results by replacing an by s„ in the right hand side of Eq. 
5.1.2 Important Special Cases 

Here, we collect model sequences and annihilation operators for some important Levin-type 
sequence transformations that were derived using the model sequence approach. For further 



examples see also llJ. The model sequences are the kernels by construction. In Section 5.2.2 



kernels and annihilation operators are stated for important Levin-type transformation that 
were derived using iterative methods. 

Levin transformation The model sequence for is 

fe-i 

an = Cr + UJn J2c,/{n + py. (199) 

j=o 

The annihilation operator is 

^l*-') = A'=(n + /?)'=-! . (200) 

Weniger transformations The model sequence for iS*^'^' is 

fe-i 

a„ =a + w„^Cj-/(n-f /3)j- . (201) 

3=0 

The annihilation operator is 

= A'=(n + /3)fe_i. (202) 

The model sequence for A^'^'^-' is 

an ^ a + ujn^Cj/{-n- . (203) 

3=0 

The annihilation operator is 

4^=) = A'=(-n-Ofc-i . (204) 

The model sequence for C^'^^ is 

fe-i 

an = a + u;n^Cj/{a[n + C])j . (205) 

3=0 

The annihilation operator is 

Al^^ = A\a[n + C])k-i. (206) 



30 



W algorithm The model sequence for VF*^'^-' is 



k-l 



an = (T + u}„ J2 cjti ■ (207) 

3=0 



The annihilation operator is 



^W=nW[K§]. (208) 

Tl Transformation The model sequence for H'^''^ is 

(fe-i fc-i \ 

exp(ian) ^ c+/{n + py + exp{-ian) ^ cj/{n + PY . (209) 
i=o j=o J 

The annihilation operator is 

= V[P^^''\a)]{n + Pf-^ . (210) 

Generalized Ti Transformation The model sequence for hC''^^) is 

A/ fe-i 

(T„ = cr + tj„ ^ e;j,^c™j(n + /3)-^' . (211) 

m— 1 i— 

The annihilation operator is 

^V[P^''^^'He)]{n + pf-^ . (212) 
5.2 Hierarchically Consistent Iteration 

As alternative to the derivation of sequence transformations using model sequences and possi- 
bly annihilation operators, one may take some simple sequence transformation T and iterate 
it k times to obtain a transformation T'^'^-' = T o . . . o T . For the iterated transformation, 
by construction one has a simple algorithm by construction, but the theoretical analysis is 
complicated since usually no kernel is known. See for instance the iterated Aitken process 
where the method plays the role of the simple transformation. However, as is discussed at 



length in Refs. ||3^, 86 1, there are usually several possibilities for the iteration. Both problems - 
unknown kernel and arbitrariness of iteration - are overcome using the concept of hierarchical 
consistency [^^,E4| that was shown to give rise to powerful algorithms like the J and the 
I transformations |^,^, Q . The basic idea of the concept is to provide a hierarchy of model 
sequences such that the simple transformation provides a mapping between neighboring levels 
of the hierarchy. To ensure the latter, normally one has to fix some parameters in the simple 
transformation to make the iteration consistent with the hierarchy. 

A formal description of the concept is given in the following taken mainly from the lit- 
erature, p^. As an example, the concept is later used to derive the JV transformation in 
Section ^.2.1 . 



Let •5cr„(c,p)§5^Q be a simple "basic" model sequence that depends on a vector c G K° of 
constants, and further parameters p. Assume that its (anti)limit (t(p) exists and is independent 
of c. Assume that the basic transformation T = T{p) allows to compute the (anti)limit exactly 
according to 

Tip) : Sa„(c,p)}} — > Mp)} . (213) 
Let the hierarchy of model sequences be given by 

{K^)(cW,p<^))|c<^)eK'^"'S}io (214) 

with a'^^^ > a^^ ^ for £ > i' . Here, £ numbers the levels of the hierarchy. Each of the model 
sequences ^<yn\c^^\p^^'')'^ depends on an a'^^^-dimensional complex vector c^^^ and further 
parameters p^^-* . Assume that the model sequences of lower levels are also contained in those 
of higher levels: For all ^ < L and all £' > i and £' < L, every sequence ^C7n \c^^\p^^^)j is 
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assumed to be representable as a model sequence fai^ \c^''''\p'^''''^)J where c^^'^ is obtained 
from c by the natural injection K"* ' K"' ' . Assume that for all £ with < £ < L 

T(p W) : SaW(cW,p W)}} -> ial!~'Hc^'''\p''~'^)} (215) 

is a mapping between neighboring levels of the hierarchy. Composition yields an iterative 
transformation 

TiL) ^ T{p'^°^) o r(p(i)) o . . . o T(p (^)) (216) 

This transformation is called "hierarchically consistent" or "consistent with the hierarchy" . 
It maps model sequences an\c^^\pf^'^^) to constant sequences if Eq. (213) holds with 

Sa(")(c(°),p("))}} = Sa„(c,p)l . (217) 



If instead of Eq. (215) we have 

nv''~^) (S^(/)(cW,p<^))S) - {{-(/-^Hc(^-i),p(^-i))l (218) 

for n — > oo for all ^ > then the iterative transformation T^^^ is called "asymptotically 
consistent with the hierarchy" or "asymptotically hierarchy-consistent" . 

5.2.1 Derivation of the JT) Transformation 

The simple transformation is the T)^"^^ transformation 



A^(.s„/tj„) 
A2(l/c^„) 



depending on the "parameters" §w„5-, with basic model sequences 

— = (T— + (an + 6) . (220) 
The more complicated model sequences of the next level are taken to be 

— ^ (J— + {an + b+ {ain + bi)rn) . (221) 

OJn IjJn 

Application of eliminates the terms involving a and b. The result is 



A^ — 



Ar„ 



= ^^^ + + «i" + ^i + 2ai-ry^ (222) 



for A^Tn ^ 0. Assuming that for large n 

■^p^ = An + B + oil) (223) 

holds, the result is asymptotically of the same form as the model sequence in Eq. ( ^20| ), 
namely 

^^a^ + {a'n + b' + o{l)). (224) 
with renormalized "parameters" 

, A2(l/a;„) 
l/w„ = — r2 (225) 

and obvious identifications for a' and 6'. 

We now assume that this mapping between two neighboring levels of the hierarchy can be 
extended to any two neighboring levels, provided that one introduces ^-dependent quantities, 
especially r„ ^ ri'^ with ci'' - A^i'^ ^ 0, s„/c^„ ^ Ni'\ l/cj„ ^ oi'^ and ^/w^ ^ Afi^+'\ 



Iterating in this way leads to the algorithm (151). 
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The condition ( ^23[ ) or more generally 

Aen + Bi + o{l) (226) 



AV(f) 

for given £ and for large n is satisfied in many cases. For instance, it is satisfied if there are 
constants Pi ^ 0, jg and Sg ^ such that 

— I for 7^ = 

A^i^) . . (227) 

— otherwise 



This is for instance the case for r^' — with C,i[C^i — 1) ^ 0. 

The kernel of JV'-^'^ may be found inductively in the following way: 

N^^^ - (tD^'''> = 

=^ A2(Ar(^fe-i) - (7i:>(^'=^-i)) = 

=^ A2(7V('=-2) _ ^ ^ 6,_i)cr') 

ri-2 j 
j=0 n'=0 

yielding the result 

iV(0) - aDi") = aon + 6o + E E Ci°? ( + &i + • ■ 

j=0 ni=0 y 

nfe-2-2 ifc_2 

...(afc_2n + 6fe-2+ E E Cn^rJ' {ak-ink-1 + bk-i) 

jk-2=0 nfc-l=0 



(228) 



(fc-2) 



(229) 



Here, the definitions Nn^ = an/cjn and I?ri''' = l/w„ may be used to obtain the model 
sequence }} for JPC^), that may be identified as kernel of that transformation, and also 
may be regarded as model sequence of the fc-tli level according to ^ail'\S''\ p''-''^)^ with c^''') = 
(flo, bo, ... , afe_i, 6fc_i) and p^'^^ corresponds to wit^ — 1/-Dn'' and the {Cn"^ |0 < k < fc — 2}. 
We note this as a theorem: 



Theorem 2 The kernel of JP^^) is given by the set of sequences §cr„5- such that Eq. ^22!\ ) 
holds with Nn^ ~ (T„/a;„ and Dn^ = l/ujn- 

5.2.2 Important Special Cases 

Here, we give the hierarchies of model sequences for sequence transformations derived via 
hierarchically consistent iteration. 

J transformation The most prominent example is the J transformation (actually a large 
class of transformations). The corresponding hierarchy of model sequences provided by the 
kernels that are explicitly known according to the following theorem: 

Theorem 3 The kernel of the j'^^^ transformation is given by the sequences ^(Jn^ with 
elements of the form 

k-l 

(Tn = (T + IjJn E ^j'^j ("■) (2^0) 
3=0 
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with 

^o{n) = 1 



ni^O 

71—1 ni— 1 

Mn) = E E '^i'.^ (231) 

m— n2— 
n>rii>n2>--->nfc-i 

zwif/i arbitrary constants Cq, ■ • • , Cfc_i . 

T transformation Since the I transformation is a special case of the J7 transformation (cp. 
Table ^ and |Q , its kernels (corresponding to the hierarchy of model sequences) are explicitly 
known according to the following theorem: 

Theorem 4 Theorem 8] The kernel of the X^^^ transformation is given by the sequences 
\<Jn^ with elements of the form 

(T„ = cr + exp(— ian)ti;„ do + di exp(2zQ!n) 

n — 1 ni— 1 / \ 

+ E E exp(2ia(ni - na)) I ^2 + ^3 exp(2ian2) | A^f^^ + • • 

+ E exp(2iQ;[ni - 712 + . . . + n2fc-3 - "2fe-2]) 



(232) 



n>ni>n2> ■ ■ ■>n2k-2 
X d2fe-2 + d2fc-l exp(2zQ;n2fe_2) 1 J| ^ni^+a 

wii/i constants do, ■ ■ ■ , d2/£-i- Thus, we have s = t\i ■'(a, ■8^s„5'i 'S'-^nS'i {A^'^''}) /or k' > k for 
sequences of this form. 

5.3 A Two-Step Approach 

In favorable cases, one may use a two-step approach for the construction of sequence trans- 
formations: 

Step 1 Use asymptotic analysis of the remainder i?„ = s„ — s of the given problem to find 
the adequate model sequence (or hierarchy of model sequences) for large n. 



Step 2 Use the methods described in Sections 5.1 or 5.2 to construct the sequence transfor- 
mation adapted to the problem. 

This is, of course, a mathematically promising approach. A good example for the two-step 
approach is the derivation of the d*^™^ transformations by Levin and Sidi (compare also 
Section U). 

But there are two difficulties with this approach. 

The first difficulty is a practical one. In many cases, the problems to be treated in appli- 
cations are simply too complicated to allow to perform Step 1 of the two-step approach. 

The second difficulty is a more mathematical one. The optimal system of functions fj (n) 
used in the asymptotic expansion, 

oo 
j=0 



with /j+i(n) = o{fj{n)), i.e., the optimal asymptotic scale [102, p. 2], is not clear a priori. 



For instance, as the work of Weniger has shown, sequence transformations like the Levin 
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transformation that are based on expansions in powers of 1/n, i.e., the asymptotic scale 
(pjin) = l/{n + py , are not always superior to, and even often worse than those based 
upon factorial series, like Weniger's S transformation that is based on the asymptotic scale 
ipj (n) = l/(n + (3)j . To find an optimal asymptotic scale in combination with nonlinear 
sequence transformations seems to be an open mathematical problem. 

Certainly, the proper choice of remainder estimates ||5^ is also crucial in the context of 
Levin-type sequence transformations. See also Section 



6 Properties of Levin- Type Transformations 
6.1 Basic Properties 



Directly from the definition in Eqs. (|65| ) and (|66|), we obtain the following theorem. The proof 
is left to the interested reader. 

Theorem 5 Any Levin-type sequence transformation T is quasilinear, i.e., we have 

r(f)(SA.„ + B}, = Ar('^-)(Ssa, M) + B (234) 

for arbitrary constants A and B. It is multiplicatively invariant in Un, i.e., we have 

r^n\iSn\, iCu^n^) = («.„!, M) (235) 

for arbitrary constants C ^ 0. 

For a coefficient set A define the sets v'^n^ [A] by 

k 

[A] = {(xo, ...,xu)e F^^+i I >^n]l^, + 0} . (236) 

Since ^n^^'SsnS'i I'^nS") for given coefficient set A depends only on the 2fc + 2 numbers 
s„, . . . , s„+fc and a;„, . . . , ujn+k, it may be regarded as a mapping 

[/ W : C^-+i X y (^) [A] =^ C , {x,y)^ {/ « {x \ y) (237) 

such that 

T'^u^ = U'^n^ (s„, . . . , s„+fc I u;„, . . . , Lu^+k) (238) 
The following theorem is a generalization of theorems for the transformation The- 
orem 5] and the T transformation Theorem 5] . 

Theorem 6 (I-O) The T'^^^ transformation can be regarded as continous 
C*^+i X y,^'[A] where yH^^A] is defined m Eq. ^3^. 

(I-l) According to Theorem^, is a homogeneous function of first degree in the first (fc-|-l) 
variables and a homogeneous function of degree zero in the last (fc-|-l) variables. Hence, 
for all vectors x G 0*^+^ and y G [A] and for all complex constants s and t ^ the 
equations 

U'^^\sx\y)=sU^^\x\y), 

[/«(x|ty)=C/«(f|y) ^ ' 

hold. 

(T2) Ur^^ is linear in the first (k + 1) variables. Thus, for all vectors x G C'^^"'^, x' G C'^^"'^, 
undyev'n^A] 

Ul^^ {x + x' I y) = {x I y) + U[^~^ {x' \ y) (240) 

holds. 

(T3) For all constant vectors c= {c, c, . . . , c) G C*''^"'^ and all vectors y G ^^'^•'[A] we have 

Ui^\c\y)=c. (241) 

PROOF. These are immediate consequences of the definitions. □ 
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6.2 The Limiting Transformation 



We note that if a limiting transformation T[N\ exists, it is also of Levin-type, and thus, the 
above theorems apply to the limiting transformation as well. 

Also, we have the following result for the kernel of the limiting transformation: 

Theorem 7 Suppose that for a Levin-type sequence transformation T'^^^ of order k there 

o o 

exists a limiting transformation T^^' with characteristic polynomial 11 G P*^ given by 

^ o *^ 

nW(z) = ^ Xfz' = \{{z - (242) 
i=o i=l 

where the zeroes Q ^ Q have multiplicities mi. Then the kernel of the limiting transformation 
consists of all sequences ^Sn^ with elements of the form 

M 

an = + t^n Y.QP,{n) (243) 



where Pi G P™*^ ^ are arbitrary polynomials and \ujn^ G Y^'^'^. 

PROOF. This follows directly from the observation that for such sequences (cr„ ^ cr)/(jj„ is 
nothing but a finite linear combination of tl 
= 0, . . . , rrif — 1 of the recursion relation 



(k) 

nothing but a finite linear combination of the solutions ip)^ ^ = n^'-Q with £ — 1, . . . , il/ and 



Y,\fun+,=Q. (244) 

o 

and thus, it is annihilated by Pfn^*^^]. □ 
6.3 Application to Power Series 

Here, we generalize some results of Weniger js^ that regard the application of Levin-type 
sequence transformations to power series. 
We use the definitions in Eq. (p7|). 

Like Pade approximants. Levin-type sequence transformations yield rational approximants 
when applied to the partial sums fn{z) of a power series f{z) with terms Oj = CjZ^. These 
approximations offer a practical way for the analytical continuation of power series to regions 
outside of their circle of convergence. Furthermore, the poles of the rational approximations 
model the singularities of f{z). They may also be used to approximate further terms beyond 
the last one used in constructing the rational approximant. 

When applying a Levin-type sequence transformation T to a power series, remainder 
estimates uJn = m„z'''+" will be used. We note that t variants correspond to m„ = c„, 7 = 0, 
M variants correspond to m„ = c„(n+/3), 7 = 0, t variants to m„ = c„+i, 7 = 1. Thus, for these 
variants, m„ is independent of z (Case A). For v variants, we have m„ = c„+ic„/ (c„ — Cn+iz), 
and 7=1. In this case, l/m„ G P*-^-* is a linear function of z (Case B). 

Application of T yields after some simplification 

n+k k Jyk) 

T« («/„(.)!, Sm„.^-S) = ^--^'^ = , (245) 



J=0 



n+j 



where in Case A, we have P^n\T] G P"+'=, Q^^^T] G P'', and in Case B, we have P''n\T] G 
p„+fc+i^ g pfc+i^ One needs the fc -f 1 + 7 partial sums /„(z), . . . , /„+fe+^(z) to 

compute these rational approximants. This should be compared to the fact that for the 
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computation of the Pade approximant [n + k + j/k + one needs the 2fc + 27 + 1 partial 

sums fn{z), . . . , fn+2k+2f{z). 

We show that Taylor expansion of these rational approximants reproduces all terms of 
power series that have been used to calculate the rational approximation. 

Theorem 8 We have 

ri'Hlfnizn, Sm„z^+"}}) - f{z) = 0(z"+'=+i+^) (246) 

where r = for t and u variants corresponding to rUn = c„, 7 = 0, or m„ = c„(n + /3), 7 = 0, 
respectively, while t = 1 holds for the v variant corresponding to to„ — Cn+iCn/{cn — c„+iz), 
7 = 1, and for the t variants corresponding to rUn = Cn+i, 7 = 1, one obtains r = 1 if T is 
convex. 

PROOF. Using the identity 

ri'HUniz)}, {{m„z^+":&) = f{z) + Tl^Hifniz) " f {z)} , im^z''+-}) = (247) 
that follows from Theorem |5[ we obtain after some easy algebra 

00 k ^(fc) 



Z V Ci+n+j+i 



T^^Hifnizn, {{m„z^+"}) - f{z) = {:°"7,^' . (248) 

This shows that the right hand side is at least 0(2"+*^+^) since the denominator is 0(1) 

(k) , ~ , 

due to A„ ^ ^ 0. For the t variant, the term corresponding to ^ = in the numera- 
tor is X]j=o ■^rf] ~ ni'°''(l) that vanishes for convex T. For the v variant, that term is 

I]i=o - c„+j+iz)/c„+j that simplifies to (-z) Y^^^q A^*^] Cn+j+i/cn+j for convex T. 

This finishes the proof. □ 



7 Convergence Acceleration Results 
for Levin- Type Transformations 

7.1 General Results 

We note that Germain-Bonne developed a theory of the regularity and convergence ac- 
celeration properties of sequence transformations that was later extended by Weniger [§4l 



Section 12], |88, Section 6] to sequence transformations that depend explicitly on n and on 
an auxiliary sequence of remainder estimates. The essential results of this theory apply to 
convergence acceleration of linearly convergent sequences. Of course, this theory can be ap- 
plied to Levin-type sequence transformations. However, for the latter transformations, many 
results can be obtained more easily and also, one may obtain results of a general nature that 
are also applicable to other convergence types like logarithmic convergence. Thus, we are not 
going to use the Germain-Bonne- Weniger theory in the present article. 

Here, we present some general convergence acceleration results for Levin-type sequence 
transformations that have a limiting transformation. The results, however, do not completely 
determine which transformation provides the best extrapolation results for a given problem 
sequence since the results are asymptotic in nature, but in practice, one is interested in 
obtaining good extrapolation results from as few members of the problem sequence as possible. 
Thus, it may well be that transformations with the same asymptotic behavior of the results 
perform rather differently in practice. 

Nevertheless, the results presented below provide a first indication which results one may 
expect for large classes of Levin-type sequence transformations. 

First, we present some results that show that the limiting transformation essentially deter- 
mines for which sequences Levin-type sequence transformations are accelerative. The speed 
of convergence will be analyzed later. 



37 



Theorem 9 Assume that the following asymptotic relations hold for large n: 

Ai'i-Af, Af^^O, (249) 



A 



E^-C ' c,c. 7^0, nW(c.) = o, (250) 

p^O, nW(l/p)^0. (251) 



i/=i 



Then, ^Tn ^ accelerates §s„5' s, i.e., we have 

lim — = . (252) 



PROOF. Rewriting 



k 



E (fc) Sn+j - S 



k 

,=0 '^"+^' 



(253) 



one may perform the limit for n — > oo upon using the assumptions according to 

k 



Tn - S j=0 



-i = = (254) 

since uj„ /^n+j P~-' ■ ^ 

Thus, the zeroes Ci/ of the characteristic polynomial of the limiting transformation are of 
particular importance. 

It should be noted that the above assumptions correspond to a more complicated conver- 
gence type than linear or logarithmic convergence if |Ci| = IC2I > ICsl ^ This is the case, 

for instance, for the TiS^^ transformation where the limiting transformation has the charac- 
teristic polynomial P^^'^-'(a) with fc-fold zeroes at exp(ia) and exp(— ia). Another example 
is the I^^^ transformation where the limiting transformation has characteristic polynomials 
Q^'^^^a) with zeroes at exp(±ia)/9j, j ~ {), . . . ,k - I. 

Specializing to A = 1 in Theorem ^, we obtain the following corollary: 

Corollary 1 Assume that the following asymptotic relations hold for large n: 

Ai'^-Af, AfVo, (255) 



LUr, 



eg", cq^O, U^''\q)= 0, (256) 

nW(l/p)^ 0. (257) 



Then, ff accelerates ^Sn^ to s, i.e., we have 

lim — = . (258) 
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Note that the assumptions of CoroUary |^ imply 

- S S„+i - S UJ„ UJn+i cq"+'^ 

= p — — = pq 259) 

S„ - S UJn+1 Sn- S W„ Cg" 

and thus, Corollary |l| corresponds to linear convergence for < \pq\ < 1 and to logarithmic 
convergence for pq — 1. 

Many important sequence transformations have convex limiting transformations, i.e., the 

o 

characteristic polynomials satisfy n('^'(l) = 0. In this case, they accelerate linear convergence. 
More exactly, we have the following corollary: 

Corollary 2 Assume that the following asymptotic relations hold for large n: 

AS-Af, AfVo, (260) 
^^^~c, CT^O, nW(l) = 0, (261) 

^^-p^O, n('=)(l/p)y^O. (262) 

Then, ^T^f^^^ accelerates ^Sn^ to s, i.e., we have 

rj-ik) _ ^ 

lim — = . (263) 

n— ►oo s„ — s 

Hence, any Levin-type sequence transformation with a convex limiting transformation accel- 
erates linearly convergent sequences with 

hm ~^ = P, 0<|p|<l (264) 

n^oo Sn — S 

o 

such that n'-'"'^(l//9) ^ for suitably chosen remainder estimates tOn satisfying (sn — s)/ujn — > 
c^O. 

PROOF. Specializing Corollary |l| to q = 1, it suffices to prove the last assertion. Here, the 
proof follows from the observation that (s„+i — s)/(s„ ~ s) ~ p and (s„ — s)/ujn ~ c imply 
ujn+i/ujn ^ p for large n in view of the assumptions. □ 

Note that Corollary ^ applies for instance to suitable variants of the Levin transformation, 
the pJ transformation and, more generally, of the J transformation. In particular, it applies 
to t, t, u and v variants, since in the case of linear convergence, one has As„/As„_i ^ p 
which entails (s„ — s)/aj„ ~ c for all these variants by simple algebra. 

Now, some results for the speed of convergence are given. Matos presented convergence 
theorems for sequence transformations based on annihilation difference operators with char- 
acteristic polynomials with constants coefficients that are close in spirit to the theorems given 
below. However, it should be noted that the theorems presented here apply to large classes 
of Levin-type transformations that have a limiting transformation (the latter, of course, has 
a characteristic polynomial with constants coefficients). 

Theorem 10 



(C-1) Suppose that for a Levin-type sequence transformation T^^^ of order k there is a limiting 

o o 

transformation T^^' with characteristic polynomial He P*^ given by Eq. (24!t) where the 
multiplicities mi of the zeroes 7^ satisfy mi < m2 < ■ . • < rnM. Let 



mi-1 



(n -I- j) 



mi — 1 



E 



jk) 

in + jY 



Ak) 



(265) 



for n 
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(C-2) Assume that ^Sn^ £ S"^ and ^oJn^ G O^. Assume further that for n — > cx) the 
asymptotic expansion 

M oo 
1=1 r=0 



holds, and put 
where 

and 



Sji s 



rt = min{r S No | fe,r+mi ^ 0} 

V 

r=0 

^mf n(fe) 



= (-1)' 



/or£ = 1,...,M. 
(C-3) Assume that the following limit exists and satisfies 



0^ lim 



P^{Ci'\e = i,...,M} 



(266) 

(267) 
(268) 

(269) 



(270) 



Then we have 



M 



fi.ri+miCe 



+m, (ri + mi 



B,, 



ri J n^e+me-mi ^ 



nW(i/p) 



Thus, ^^n''' (S-^nl, ^i^nS)! CLCcelcrates ^Sn^ to s at least with order 2mi, i.e., 



0(71-^™!-^), T>Q, 



Q,o 7^ 0,11 £. 



PROOF. We rewrite rr^(|s„§, fiVn}) = T^n as defined in Eq. (|T|) in the form 



s = a;„ 



EAit 

J=0 



(fe) ^Tt 



fe 



(271) 



(272) 



(273) 



for large n where we used Eq. ( 265 ) in the numerator, and in the denominator th e re lation 
LOnl'-On+j ^ P '' that foUows by repeated application of Eq. (27C). Insertion of (266) now 
yields 



M oo 



— ^ E E E 

n-l n('=)(l/p) fcl r=0 j=0 



(fe) c 



n+j 



{n + j) 



r+l 



(274) 



o 

where Eq. (E6q) was used. Also the fact was used that 7'[n'-'^^] annihilates any linear combina- 
tion of the solutions ip^^\ = n^'^Q with I = 1, . . . , M and = 0, . . . , mi — 1 of the recursion 
relation (244) since each Q is a zero with multiplicity exceeding toi — 1. Invoking Lemma 
given in Appendix ^ one obtains 



M oo / I \ 

\ ^ \ ^ „ >n+mf If + rn^s 

e—t 1 — n ^ / 



n('=)(l/p) fcl r=0 



r + mA (-1)™' d"^nW 



(0) (275) 
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The proof of Eq. (^71|) is completed taking leading terms in the sums over r. Since s„ — s ~ 
w„^" y^g/(0/^)"Q,o where Z = max{|C£| |£ = 1, . . . , M}, and / = {£ = 1, . . . , M\ Z = 101}, 
Eq. (273) is obtained where r = minjr^ + mi — m,\ | G /}. □ 

o I I 

If Wn+i/wn ~ p, where n('^^(l/p) = 0, i.e., if (C-3) of Theorem does not hold, then 
the denominators vanish asymptotically. In this case, one has to investigate whether the 
numerators or the denominators vanish faster. 

Theorem 11 Assume that (C-1) and (C-2) of Theorem hold. 
(C-3') Assume that for n ^ oo the asymptotic relation 



pexp(e„), p^O (276) 



holds where 



and 



Id^lW fo forX^O,...,p-l 

A!^i^(^/^)=| C^O forX^p ^'"'^ 

e„ ^ , ^ ^ 1 (278) 



e 

for large n. Define (5„ via exp(— e„) = 1 + SnP 
Then we have for large n 

M 



n+rni f + mA 



PROOF. The proof proceeds as the proof of Theorem [l^ but in the denominator we use 

i2ti^-m,r (280) 



3=0 



n+j 



that follows from Lemma ^ given in Appendix □ 

Thus, the effect of the sequence transformation in this case essentially depends on the 
question whether (5„)~^n~^™^ goes to for large n or not. In many important cases like the 
Levin transformation and the pJ transformations, we have AI = 1 and mi = k. We note that 
Theorem ^ becomes especially important in the case of logarithmic convergence since for 
instance for M = 1 one observes that (s„+i — s)/(s„ — s) 1 and (s„ — s)/cj„ ^ C"ci,o 7^ 
imply LUn+i/uJn ^ 1/Ci foi' large n such that the denominators vanish asymptotically. In this 
case, we have p = nii whence ((5„)^''n^^'™i ~ 0{n^"^'^) if (5„ = 0{l/n). This reduction 
of the speed of convergence of the acceleration process from 0{n^^'') to 0{n^'') in the case 
of logarithmic convergence is a generic behavior that is reflected in a number of theorems 
regarding convergence acceleration properties of Levin- type sequence transformations. Exam- 
ples are Sidi's theorem for the Levin transformation given below (Theorem p^), and for the p3 
transformation the Corollaries |^ and ^ given below. Compare also Theorems 13.5, 13.9, 
13.11, 13.12, 14.2]. 

The following theorem was given by Matos where the proof may be found. To formulate 
it, we define that a sequence •8^u„5' property M if it satisfies 

!f!i±i ^i + -+rn with r„ = o(l/n) , AV„ = o(A^(l/n)) for n ^ 00 . (281) 
Un n 
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Theorem 12 Theorem 13] Let ^Sn^ be a sequence such that 

s„ - s = ujn{aig[^^ (n) H h akg[^^ (n) + p„) (282) 

with g\^^^\n) = o{g[^\n)) , p„ = o(g[''\n)) for n — > oo. Let us consider an operator L of the 
form (195) for which we know a basis of solutions ^Un^^, j = 1, . . . ,k, and each one can be 
written as 

oo 

'^'^ - E (") , 9^£+iin) = o(g«(n)) (283) 



m— 1 



(284) 



as n —> oo for all m G N and j = I, . . . ,k. Suppose that 

a) g2^^\''^) = o{g2\n)) for n—>-oo,j = l,...,k — l 

b) 92\n) ^ o{g[''\n)) , and pn ^ Kg[^\n) f or n ^ oo 

c) i^glii'in)^ has property M for 
m eN ,j ^ 1, . . . ,k. 

Then 

1. //§tj„§ satisfies lim„_,oo i-^^n/wn+i = 7^ 1, the sequence transformation T^i^^'' corre- 
sponding to the operator L accelerates the convergence of ^Sn^. Moreover, the acceler- 
ation can be measured by 

^" _ ' ^Cn-'^^lJ^, n^oo. (285) 

2. If has property M, then the speed of convergence of T[i^^^ can be measured by 

^" _ ' ^ C^-TTT^ ' " ^ ■ (286) 
7.2 Results for Special Cases 

In the case that pecuhar properties of a Levin-type sequence transformation are used, more 
stringent theorems can often be proved as regards convergence acceleration using this partic- 
ular transformation. 

In the case of the Levin transformation, Sidi proved the following theorem: 



Theorem 13 /|7f /gj, Theorem 2.32] If s„ = s + w„/„ where /„ - Yl%a Pol^' /3o ^ 
and uJn ^ X^jlo Sj/n^^'^ with a > 0, Sq ^ for n ^ oo then, if (3k ^ 

Cl^^ - s ^ ■ n-^^'^ (n->oo). (287) 

\ k ) 

For the W algorithm and the d*-^-* transformation that may be regarded as direct gen- 
eralizations of the Levin transformation, Sidi has obtained a large number of results. The 
interested reader is referred to the literature (See j?^, Q and references therein) . 

Convergence results for the Levin transformation, the Drummond transformation and the 
Weniger transformations may be found in Section 13 of Weniger's report |Q. 

Results for the J7 transformation and in particular, for the pJ transformation are given in 
|3^,0. Here, we recall the following theorems: 

Theorem 14 Assume that the following holds: 
(A-0) The sequence ^Sn^ has the (anti)limit s. 

(A-la) For every n, the elements of the sequence ^i-^n\ are strictly alternating in sign and 
do not vanish. 
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(A-lb) For all n and k, the elements of the sequence ^5^^^^ = •^Ar^'^^J '^''^ of the same sign 
and do not vanish. 



(A-2) For all n G No the ratio {s„ — s)/ujn can he expressed as a series of the form 



j=l n>ni>n2>->nj 



(288) 



with Co 0. 

Then the following holds for s'^n^ = Jn\^Sn}, {{^^rj}, {{<5rf^}})' 
a) The error s^'^ — s satisfies 



7(fc-l)„(fc-2) 



Vl°)[l/cc>„] 



with 



oo 

j=fe+l T!>nfc_|_i>nfc_|_2>--->"3 



b) The error s^n^ ~ s is hounded in magnitude according to 

c) For large n the estimate 



(fe) 

Sn - S 



(289) 
(290) 

(291) 
(292) 



holds if h[\^ — 0{\) and {sn — s)/ujn = 0(1) as n ^ oo. 



Theorem 15 Define si^'' = Jn\isn},i^n},iSl!'^}) and u'^^ = 1/A^^ where the dH"^ are 
defined as in Eq. ^2). Put e.[f'' — 1 — w^j^j^/wi'^'' and h^n^ = {s^rf' — s)/uj^K Assume that 
(A-0) of Theorem 1^ holds and that the following conditions are satisfied: 

(B-1) Assume that 



n— >-oo 



(293) 



exists and is finite. 
(B-2) Assume that 

and 



, ,(fe) 

"fe = lim — 7T-- 



Fk = lim 

n— *-oo J 



■ „ " rt+l 
(fc) 



7^0 



^0, 



(294) 



(295) 



exist for all fc G Nq. Hence the limits $fe = lim„^(X) ^rf^ (compare Eq. ([g^j exisi /or 
fc e No. 

Then, the following holds: 

a) //r!o^{*o = l,$i,...,*fe-i}, i/ierz 



lim 



(fe) 



'fe-i 



= Bk 



fe-i 



(296) 



n(*'-^^o) 



and, hence. 



holds in the limit n — » oo. 



(fe) 

Sn - S 



Sn S 



(297) 
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b) // rj; = 1 /or / G {0, 1, 2, . . . , k} then 

-1 



(k) _ „ ffe-l M , 



ond, hence, 



0(n^ (299) 



holds in the limit n — s- cx). 
This theorem has the following two corollaries for the pj transformation p9t : 
Corollary 3 Assume that the following holds: 

(C-1) Let (3 > ,p > 1 and si!'^ = A[(n + f3 + {p ~ l)fc)-i]. Thus, we deal with the p3 

transformation and, hence, the equations Fk = lim„^oo '^I'+i/'^rf '' = 1 and — 1 hold 
for all k. 

(C-2) Assumptions (A-2) of Theorem |7J and (B-1) of Theorem |7J are satisfied for the par- 
ticular choice ( C-1 ) for S^i"^ . 

(C-3) The limit fig = lim„^oo ^n+i/'^n exists, and it satisfies fZg ^ {0,1}. Hence, all the 
limits rjfe = lim„^oo ^\i+il^ri^ exist for G N exist and satisfy ^Ik — i^o- 



Then the transformation sit"^ = pjl*"^ (/3, fsnj-, -^WnJ-) satisfie 



. i=0 



and, hence, 

(k) _ 

^ = 0((n + /3)-2'=) (301) 

Sn S 

holds in the limit n —* oo. 

Note that Corollary |^ can be applied in the case of linear convergence because then < 
|f7o| < 1 holds. 

Corollary H allows to conclude that in the case of linear convergence, the p3 transformations 
should be superior to Wynn's epsilon algorithm [104|. Consider for instance the case that 

oo 

j^O , n ^ oo (302) 

is an asymptotic expansion of the sequence elements s„. Assuming X ^ 1 and 6* ^ {0, 1, . . . , k — 
1} it follows that (|02|, p. 127]; @, p. 333, Eq. (13.4-7)]) 



(«) _ 

^^'^ ' = O , n^oo. (303) 



This is the same order of convergence acceleration as in Eq. ( pOll ). But it should be noted 
that for the computation of ej'^'' the 2fc + 1 sequence elements {s„, . . . , Sn+2fe} are required. 
But for the computation of pJ^'^'' only the k-\-l sequence elements {s„, . . . , Sn+k} sue required 
in the case of the t and u variants, and additionally Sn+k+i hi the case of the t variant. Again, 
this is similar to Levin-type accelerators (|^, p. 333]). 

The following corollary ^ applies to the case of logarithmic convergence: 

Corollary 4 Assume that the following holds: 
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(D-1) Let P > ,p > 1 and Si^'^ = A[(n + (3 + {p - l)k)-'^]. Thus, we deal with the p3 

transformation and, hence, the equations Fk — lim„^oo '^I'+i/'^i'^'' — 1 and = 1 hold 
for all k 

(D-2) Assumptions (A-2) of Theorem ^ and (B-1) of Theorem ^ are satisfied for the 
particular choice ( C-1 ) for ji*'' . 

(D-3) Some constants a[^\ j — 1,2, exist such that 

e« ^ 1 - = 4^ + r4-!^ + ^(('^ + ^)"') (304) 

n + p (n + pY 



holds for 1 = 0. This implies that this equation, and hence, Qi = 1 holds for I G 

(1 

(fc) _ ,(fc). 



{0,1, 2,..., A:}. Assume further that al^^ ^ for I £ {0, 1, 2, . . . , A: - 1}. 



Then the transformation s„ = pJn (/3, §5^1, 'S'-^nS') satisfies 

'1 



Hnif!^ ^11%) =^'= (305) 

I. 1=0 e« J 

and, hence, 

^^^—^ = 0((?i + /?)-'=) (306) 

/loZds in the limit n — > oo. 

For convergence acceleration results regarding the 7i and X transformations, see p3] and 



8 Stability Results for Levin- Type Transformations 

8.1 General Results 

We remind the reader of the definition of the stability indices T^^^ (T) > 1 as given in Eq. 
(76). We consider the sequence -^^ijJnl ^ ®^ given. We cah the transformation T stable 
along the path V = {{n^, k£)\[n( > n^-i and ki > fcf_i] or [ni > n^-i and ki > ki-i]} in the 
T table if the limit of its stability index along the path V exists and is bounded, i.e., if 

£in r('=/)(T) = /nn E I^S^'^")! < ~ (^07) 

where the 7i'^](i^n) are defined in Eq. ([TS]). The transformation T is called S-stable, if it is 
stable along all paths 'P''^-' = {(n, k)\n = 0, 1, . . .} for fixed k, i.e. along all columns in the T 
table. 

The case of stability along diagonal paths is much more difficult to treat analytically unless 
Theorem |l^ applies. Up to now it seems that such diagonal stability issues have only been 
analysed by Sidi for the case of the d'-^-' transformation (see ||7^ and references therein). We 
will treat only S-stability in the sequel. 

The higher the stability index T{T) is, the smaller is the numerical stability of the trans- 
formation T: If ej is the numerical error of Sj , 

ej =sj - fl(sj) (308) 

then the difference between the true value tI^'^ and the numerically computed approximation 
may be bounded according to 



Ti'^) - f 1 ( Ti'' 



<rW(r) max ^ le„+,| . (309) 
je{o,i,...,k} 



Compare also 
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Theorem 16 // the Levin-type sequence transformation T^^^^ has a limiting transformation 

o o 

T^''^ with characteristic polynomial n'*^' G P^'^^ for all k G N, and if ^L^n^ G satisfies 

o 

ujn+i/i^n ^ p ^ for large n with n*^'')(l/p) 7^ for all k £ N then the transformation T 

°(k) 

is S-stable. If additionally, the coefficients of the characteristic polynomial alternate in 



sign, i.e., if = {—iy\\'"p\/Tk with |rfe| — 1, then the limits T^^\T) = lim„_^oo T^'"'' (T) 



(fe) 



obey 



rW(r) 



Tfe- 



nW(-i/IH) 
|nw(i/p)| 



(310) 



PROOF. We have for fixed k 



(fc) 



n('=)(i/p) 



(311) 



whence 



fc v^fe I \ C^) I I \—j 

hm r('=)(r) . hm Y: l7S-(-.)l = ^' < 00 - 

j=o |nW(i/p)| 



If the A^- alternate in sign, we obtain for these hmits 



(312) 



r(fe)(r) 



Tk- 



E.toAf (-IpI)- 



|n«(i/p)| 



This implies Eq. (31C). □ 



(313) 



Corollary 5 Assume that the Levin-type sequence transformation T*-*^-* has a limiting trans- 
formation T^^"^ with characteristic polynomial H'-'^^ G P*-*^-* and the coefficients A^- of the 

characteristic polynomial alternate in sign, i.e., i/ A^'^' = {—^y\X^p\/Tk with \Tk\ = 1 for all 
/c G N. The sequence \^ujn^ G O"^ is assumed to he alternating and to satisfy uin+il'^n ^ p < 

o 

for large n. Then the transformation T is S-stable. Additionally the limits are r('^''(T) = 1. 
PROOF. Since 



aJ], c.„ n('=)(i/p) 



k 

y 



' A?) 



j'=0 ^k 



(314) 

o I I 

1/p cannot be a zero of H^*^^. Then, Theorem |l^ entail that T is S-stable. Furthermore, Eq. 



(310) is applicable and yields r('^')(r) = 1. □ 



(k) 

This result can be improved if all the coefficients A„ j are alternating: 

Theorem 17 Assume that the Levin-type sequence transformation T^*^^ has a characteristic 
polynomials Tlii^ G P''^^' with alternating coefficients A|j'^'^- i.e., X^^^j = (— 1)-'|A^'^^-|/t/; with 
Tfel = 1 for all n G No and fc G N. The sequence ^u!n^ G is assumed to be alternating and 
to satisfy uJn+i/uJn < for all n G Nq. Then we have Til'\T) = 1. Hence, the transformation 
T is stable along all paths for such remainder estimates. 
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PROOF. We have for fixed n and k 

7„. K) = — TTT^ — = . = . > 



(315) 

Note that the denominators cannot vanish and are bounded from below by {x'^^ujn/i^n+kl > 0. 

Hence, we have 7^w„) = |7ij ('2n)| and consequently, Ti!'\T) = 1 since Z]^=o tIj (i^n) = 1 
according to Eq. ([75|). □ 

8.2 Results for Special Cases 

Here, we collect some special results on the stability of various Levin-type sequence transfor- 
mations that have been reported in |p6t and generalize some results of Sidi on the S-stability 
of the d^^^ transformation. 

Theorem 18 If the sequence Un+i/i-^n possesses a limit according to 

lim ujn+i/uj„ = p ^ (316) 

n — ^oo 

and if p ^ {1, $1, . . . , . . .} such that the limiting transformation exists, the J transfor- 

o 

motion is S-stable with the same limiting stability indices as the transformation J, i.e., we 
have 

lini r('^) = 1 ' < 00 . (317) 

n-r=ol'i>.'-H 

// all $fc are positive then 

- n < - (318) 

„^oo - p\ 

holds. 

As corollaries, we get the following results 
Corollary 6 If the sequence LOn+i/^n possesses a limit according to 

lim ujn+i/ur, = p ^ {0, 1} (319) 
the pJ transformation for p > 1 and f3 > is S-stable and we have 

j: IoO\p'-'\ ^ ii + \p\r 



,™r«.^aA^.iii^<oo^ (320) 



Corollary 7 If the sequence LUn+i/^n possesses a limit according to 

lim uj„+i/LOn = P ^ {0, 1} (321) 



the Weniger S transformation / p^ 5*60. 5/ for (3 > is S-stable and we have 

Jim n ^(5) = |^_^|, = < oo • (322) 

Corollary 8 If the sequence ujn+i / Lli„ possesses a limit according to 

lim tj„+i/cj„ = p^{0,l} (323) 

n— i-oo 

the Levin jC transformation is S-stable and we have 

0\p'-'\ ^ ii + \p\Y 



hm_ r(^) iO = ^^:r^Z ' = V^Z < oo . (324) 
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Corollary 9 Assume that the elements of the sequenee {injneN satisfy tn ^ for all n and 
tn 7^ tn' for all n ^ n' . If the sequence tn+i/t„ possesses a limit 

lim tn+i/tn = T with < T < 1 (325) 

n — >oo 

and if the sequence ojn+i/^n possesses a limit according to 

lim uj„+i/LJn = p ^ {0, 1, T-\ . . . , r-^ . . .} (326) 



then the generalized Richardson extrapolation process TZ introduced by Sidi that is identical 
to the J transformation with S^!^^ = tn — tn+k+i as shown in ^djj, i.e., the W algorithm is 
S-stable and we have 



lim r(^) (TZ) - - rf ^ + ^''1^' < oo f327) 



Here, 



such that 



fc-i 



30+Jl+--+Jfc-i=3' m=0 
joe{o.i},.^.,jfc_ie{o,i} 



fe-1 k-1 



^ Af)/-. ^ l[(r-^ -p)^ r-'i^~i)/2 -Q(i _ (329) 
i=o j=o j=o 

Note that the preceeding corollary is essentially the same as a result of Sidi Theorem 
2.2] that now appears as a special case of the more general Theorem |l^ that applies to a much 
wider class of sequence transformations. As noted above, Sidi has also derived conditions 
under which the d'^^^ transformation is stable along the paths Vn = {{n, k)\k — 0, 1, . . .} for 
fixed 71. For details and more references see [Q. Analogous work for the JT" transformation is 
in progress. 

An efficient algorithm for the computation of the stability index of the transformation 
can be given in the case 6n > 0. Since the transformation is invariant under (S„ — > a 
for any a'*^' ^ according to Theorem 4], ji*'' > can always be achieved if for given fc, 
all Sii^ have the same sign. This is the case, for instance, for the pJ transformation [^,|39[|. 

Theorem 19 Define 

= (-l)"|i?i°)| , Fi'^+i) ^ (Fiti - (330) 
and = F^^\ Fi'^ = (^1°) ■ • • Si'-''>) Fi'l If all S^t^ > then 

1. Fi^^ = {-ir+''\Fi^^\, 

2. Ai';)=(-l)^+'=|ASb and 



3. 



rW = ^ = ^ . (331) 

This generalizes Sidi's method for the computation of stability indices ||7^ to a larger class of 
sequence transformations. 
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9 Application of Levin-type Sequence Transformations 



9.1 Practical Guidelines 

Here, we address shortly the following questions: 

When should one try to use sequence transformations? One can only hope for good 
convergence acceleration, extrapolation, or summation results if a) the s„ have some 
asymptotic structure for large n and are not erratic or random, b) a sufficiently large 
number of decimal digits is available. Many problems can be successfully tackled if 
13-15 digits are available but some require a much larger number of digits in order to 
overcome some inevitable rounding errors, especially for the acceleration of logarithmi- 
cally convergent sequences. The asymptotic information that is required for a successful 
extrapolation is often hidden in the last digits of the problem data. 

How should the transformations be applied? The recommended mode of application is 
that one computes the highest possible order k of the transformation from the data. In 
the case of triangular recursive schemes like that of the J transformation and the Levin 
transformation, this means that one computes as transformed sequence S^o"^S- ^'^^ ^" 
shaped recursive schemes as in the case of the 7i, X, and /C transformations, one usually 
computes as transformed sequence 'S^|i''""2|n/2]S'- The error e of the current estimate 
can usually be approximated a posteriori using sums of magnitudes of differences of a 
few entries of the T table, e.g., 

e « it'"' - r(,")| + \Ti"-'^ - r("^| (332) 

for transformations with triangular recursive schemes. Such a simple approach works 
surprisingly well in practice. The loss of decimal digits can be estimated computing 
stability indices. An example is given below. 

What happens if one of the denominator vanishes? The occurrence of zeroes in the D 
table for specific combinations of n and k is usually no problem since the recurrences 
for numerators and denominators still work in this case. Thus, no special devices are 
required to jump over such singular points in the T table. 

Which transformation and which variant should be chosen? This depends on the type 
of convergence of the problem sequence. For linearly convergent sequences, t, t, u and 
V variants of the Levin transformation, the pJ transformation, especially the 2J trans- 
formation are usually a good choice |^ as long as one is not too close to a singularity 
or to a logarithmically convergent problem. Especially well-behaved is usually the ap- 
plication to alternating series since then, the stability is very good as discussed above. 
For the summation of alternating divergent sequences and series, usually the t and the t 
variants of the Levin transformation, the 2J and the Weniger S and M transformations 
provide often surprisingly accurate results. In the case of logarithmic convergence, t 
and t variants become useless, and the order of acceleration is dropping from 2k to k 
when the transformation is used columnwise. If a Kummer-related series is available 



(cp. Section 2.2.1), then K and lu variants leading to linear sequence transformations 



can be efficient [ pO[ . Similarly, linear variants can be based on some good asymptotic 
estimates "■'^^LOn, that have to be obtained via a separate analysis |^0|. In the case of log- 
arithmcic convergence, it pays to consider special devices like using subsequences -S^s^^J- 
where the ^„ grow exponentially like f„ — |crfn-i] + 1 hkc in the d transformations. 
This choice can be also used in combination with the T transformation. Alternatively, 
one can use some other transformations like the condensation transformation ^ or 
interpolation to generate a linearly convergent sequence , before applying an usually 
nonlinear sequence transformation. A somewhat different approach is possible if one can 
obtain a few terms a„ with large n easily . 

What to do near a singularity? When extrapolating power series or, more generally, se- 
quences depending on certain parameters, quite often extrapolation becomes difficult 
near the singularities of the limit function. In the case of linear convergence, one can 
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often transform to a problem with a larger distance to the singularity: If Eq. ( |28| ) holds, 
then the subsequence fsmS satisfies 

lim (Sr(n+1) - s)/{Srn - s) = (333) 
n — >oo 

This is a method of Sidi that has can, however, be applied to large classes of sequence 
transformations p6|] . 

What to do for more complicated convergence type? Here, one should try to rewrite 
the problem sequence as a sum of sequences with more simple convergence behavior. 
Then, nonlinear sequence transformations are used to extrapolate each of these simpler 
series, and to sum the extrapolation results to obtain an estimate for the original prob- 
lem. This is for instance often possible for (generalized) Fourier series where it leads 
to complex series that may asymptotically be regarded as power series. For details, the 
reader is referred to the literature |p^,|35|, ^0|-^,|77||. If this approach is not possible one 
is forced to use more complicated sequence transformations like the d*^™) transformations 
or the (generalized) TL transformation. These more complicated sequence transforma- 
tions, however, do require more numerical effort to achieve a desired accuracy. 



9.2 Numerical Examples 

In Table |^, we present results of the application of certain variants of the J- transformation 
and the W algorithm to the series 

oo j-l 

5(.,a)^l + E-^ni^^ (334) 

with partial sums 

Sn{z,a) = l + Y.^^X{—^ (335) 

j = l l=Q ^ ' 

for z — \.2 and a = 1.01. Since the terms aj satisfy aj+i/aj — zj In(a-t-j), the ratio test reveals 
that S(z^ a) converges for all z and, hence, represents an analytic function. Nevertheless, only 
for 2 > — a-|-exp(|z|), the ratio of the terms becomes less than unity in absolute value. Hence, 
for larger z the series converges rather slowly. 

It should be noted that for cases C„ and G„, the T transformation is identical to the 
Weniger transformation S, i.e., to the 3 J transformation, and for cases C„ and iJ„ the W 
algorithm is identical to the Levin transformation. In the upper part of the table, we use 
u-type remainder estimates while in the lower part, we use t variants. It is seen that the 
choices a;„ = 1 -I- ln(a -I- n) for the !F transformation and i„ — 1/(1-1- ln(a -I- n)) for the W 
algorithm perform for both variants nearly identical (columns An, Bn, En and Fn) and are 
superior to the choices Xn = l + n + a and t„ = 1/(1 -|- n + a), respectively, that correspond to 
the Weniger and the Levin transformation as noted above. For the latter two transformations, 
the Weniger *S transformation is slightly superior the *£ transformation for this particular 
example (columns Gn vs. iJ„) while the situation is reversed for the u-type variants displayed 
in colums C„ and Z?„. 

The next example is taken from namely the "inflated Riemann ^ function", i.e., the 
series 

00 j 

j=Q ^ ' 

that is a special case of the Lerch zeta function C(s, 6, z) (cf. p. 142, Eq. (6.9.7)] and 
Sec. 1.11]). The partial sums are defined as 

The series converges linearly for < [gj < 1 for any complex e. In fact, we have in this case 
p = hm„^oo(sn+i — s)/{sn — s) — q. We choose q — 0.95 and e — —0.1 + 10«. Note that for 
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Table 3: Comparison of the T transformation and the W algorithm for the series (334) 



n 










14 


13.16 


13.65 


7.65 


11.13 


16 


15.46 


15.51 


9.43 


12.77 


18 


18.01 


17.84 


11.25 


14.43 


20 


21.18 


20.39 


13.10 


16.12 


22 


23.06 


23.19 


14.98 


17.81 


24 


25.31 


26.35 


16.89 


19.53 


26 


27.87 


28.17 


18.83 


21.26 


28 


30.83 


30.59 


20.78 


23.00 


30 


33.31 


33.19 


22.76 


24.76 






-' n 


Gn 




14 


14.07 


13.18 


9.75 


10.47 


16 


15.67 


15.49 


11.59 


12.05 


18 


17.94 


18.02 


13.46 


13.66 


20 


20.48 


20.85 


15.37 


15.29 




OQ 1 
ZO.iJi 


Zo.OL 


i ( .oU 


10.90 


24 


25.66 


25.63 


19.25 


18.62 


26 


27.89 


28.06 


21.23 


20.31 


28 


30.46 


30.67 


23.22 


22.02 


29 


31.82 


32.20 


24.23 


22.89 


30 


33.43 


33.45 


25.24 


23.75 



Plotted is the negative decadic logarithm of the relative error. 

A„: 4"'(|5„(z, a)S, |(2 + ln(n + a))A5„(^, a)}, §1 + ln(n + a)}}) 

Bn. W^^\lSn{z, a)l, {{(2 + ln(n + a))A5„(^, a)}, |1/(1 + ln(n + a))l) 

C„: J^[,"^(S5„(z, a)}}, i{n + l)A5„(z, a)}, ^1 + n + a}}) 

7^„: W^[,")(S5„(z, a)}}, |(n + l)A5„(z, a)^, {{1/(1 + n + a)}) 

i?„: .f|,")(S5„(z, a):^, «A5„(z, a)}}, |1 + ln(n + a)}}) 

F„: W^<,"^ (|5„(z, a):&, «A5„(z, a)}, il/(l + ln(n + a))}}) 

G„: 4"'(S5„(z, a)}}, iASniz, a)S, ^1 + n + a|) 

i/„: a)]J, SA5„(z, a)}, |:i/(l + n + a)}}) 



this value of e, there is a singularity of C,{e, l^q) a,t q — \ where the defining series diverges 
since 5l?(e) < 1. 

The results of applying u variants of the pJ transformation with p = 1,2,3 and of the Levin 
transformation to the sequence of partial sums is displayed in Table ^. For each of these four 
variants of the J transformation, we give the relative error and the stability index. The true 
value of the series (that is used to compute the errors) was computed using a more accurate 
method described below. It is seen that the 2J transformation achieves the best results. The 
attainable accuracy for this transformation is limited to about 9 decimal digits by the fact 
that the stability index displayed in the column £)„ of Table ^ grows relatively fast. Note that 
for n = 46, the number of digits (as given by the negative decadic logarithm of the relative 
error) and the decadic logarithm of the stability index sum up to approximately 32 which 
corresponds to the maximal number of decimal digits that could be achieved in the run. Since 
the stability index increases with n, indicating decreasing stability, it is clear that for higher 
values of n the accuracy will be lower. 

The magnitude of the stability index is largely controlled by the value of p, compare 
Corollary ^. If one can treat a related sequence with a smaller value of p, the stability index 
will be smaller and thus, the stability of the extrapolation will be greater. 

Such a related sequence is given by putting si — s^^ for £ G No, where the sequence is 
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Table 4: Acceleration of C(-l/10 + 10», 1, 95/100) with the J transformation 



n 




Bn 


Cn 


Dn 


En 


Fn 


Gn 


Hn 


10 


2.59e-05 


3.46e+01 


2.11e-05 


4.67e+01 


1.84e-05 


4.14e+01 


2.63e-05 


3.90e+01 


20 


1.72e-05 


6.45e+05 


2.53e-05 


5.53e+07 


1.38e-04 


3.40e+09 


1.94e-05 


2.47e+06 


30 


2.88e-05 


3.52e+10 


8.70e-06 


2.31e+14 


8.85e-05 


1.22e+17 


2.02e-05 


6.03e+ll 


40 


4.68e-06 


1.85C+15 


8.43e-08 


1.27e+20 


4.06e-06 


2.78C+23 


1.50e-06 


9.27e+16 




z.oye-UD 


i.4oe+io 


1 ^ no 

z.oie-Uo 


i.oie+zi 


z.Uie-Ub 


A 1 0/1 

4. /UeH-z4 


D.o4e-U ( 


C 1 1 7 

0.0 <e+i ( 


AA 
44 


1.33e-06 


l.lOe+17 


1 PiOo. no 




i. / oe-UD 


( .ooe-|-zo 


L. / oe-u { 


( ./4e-|-io 


Afi 
40 


6.46e-07 


8.00e+17 


1 Q.f\o. no 
i.oue-uy 




i.oie-uo 




i.uye-u { 


D.Uoe-|-iy 


48 


2.97e-07 


5.62e+18 


1.07e-08 


2.29e+24 


1.52e-04 


2.12e+28 


4.16e-08 


5.00e+20 


50 


1.31e-07 


3.86e+19 


1.51e-07 


2.56e+25 


1.66e-03 


3.43e+29 


1.54e-08 


4.05e+21 


An 


: Relative 


error of iJg" 






-^n-l)S) 








Bn 


: Stability index of iJq 






I - S„_l)| 


) 






Cn 


; Relative 


error of 2J0 




,|(n+l)(s„ 


-sn-im 









Dn : Stability index of aJ^ (1. -^^nj, + 

En : Relative error of 3Jo"''(l> f s„J, •g;(n + l)(s„ - Sn-\)1) 

Fn : Stability index of 3J^"^(1, l{n + l)(s„ - s„-i)J) 

G„ : Relative error of J^"^ (|s„S, + l)(s„ - s„_i)S, {l/(n + 1) - l/(n + + 2)}) 
Hn : Stability index of J, |:(n + l)(s„ - J, {l/(n + 1) - l/(n + k + 2)}) 



Table 5: Acceleration of C(-l/10 + 10^, 1, 95/100) with the J transformation (r = 10) 



n 


An 


Bn 


Cn 


Dn 


En 


Fn 


Gn 


Hn 


10 


2.10e-05 


2.08e+01 


8.17e-06 


3.89e+01 


1.85e-05 


5.10e+01 


1.39e-05 


2.52e+01 


12 


2.49e-06 


8.69e+01 


1.43e-07 


3.03e+02 


9.47e-06 


8.98e+02 


1.29e-06 


1.26e+02 


14 


1.93e-07 


3.11e+02 


5.98e-09 


1.46e+03 


8.24e-07 


4.24e+03 


6.86e-08 


5.08e+02 


16 


l.lle-08 


9.82C+02 


2.02e-ll 


6.02e+03 


6.34e-08 


2.09e+04 


2.57C-09 


1.77C+03 


18 


5.33C-10 


2.87C+03 


1.57e-12 


2.29e+04 


4.08e-09 


9.52C+04 


7.810-11 


5.66C+03 


20 


2.24e-ll 


7.96e+03 


4.15e-14 


8.26e+04 


2.31e-10 


4.12e+05 


2.07e-12 


1.73e+04 


22 


8.60e-13 


2.14e+04 


8.13e-16 


2.89e+05 


1.16e-ll 


1.73e+06 


4.95e-14 


5.08e+04 


24 


3.07e-14 


5.61e+04 


1.67e-17 


9.87e+05 


5.17e-13 


7.07e+06 


l.lOe-15 


1.46e+05 


26 


1.04e-15 


1.45C+05 


3.38e-19 


3.31e+06 


1.87e-14 


2.84C+07 


2.33C-17 


4.14C+05 


28 


3.36C-17 


3.69C+05 


6.40C-21 


l.lOe+07 


3.81C-16 


1.13C+08 


4.71e-19 


1.16C+06 


30 


1.05C-18 


9.30C+05 


1.15C-22 


3.59e+07 


1.91C-17 


4.43C+08 


9.19e-21 


3.19e+06 
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Table 6: Stability indices for the 2J transformation (t = 10) 



n 


p(i) 

■L n 


J- n 


p{3) 
■L n 


T.(4) 
J- n 


T.(5) 

-■- 71 


J- n 


■L n 


20 


3.07 


9.26 


2.70 10^ 


7.55 10^ 


2.02 10^ 


5.20 10^ 


1.29 10^ 


30 


3.54 


1.19 10^ 


3.81 10^ 


1.16 10^ 


3.36102 


9.36 102 


2.51103 


40 


3.75 


1.33 10^ 


4.49 10^ 


1.44 10^ 


4.42 10^ 


1.30103 


3.71103 


41 


3.77 


1.34 10^ 


4.54 10^ 


1.46 10^ 


4.51 10^ 


1.34 10^ 


3.82103 


42 


3.78 


1.35 10^ 


4.59 10^ 


1.49 10^ 


4.60 10^ 


1.37103 


3.93103 


43 


3.79 


1.36 10^ 


4.64 10^ 


1.51 10^ 


4.69 10^ 


1.40 10^ 


4.05103 


44 


3.80 


1.37 10^ 


4.68 10^ 


1.53 102 


4.77 10^ 


1.43 10^ 




45 


3.81 


1.38 10^ 


4.73 10^ 


1.55 10^ 


4.85 10^ 






46 


3.82 


1.39 10^ 


4.77 10^ 


1.57 10^ 








47 


3.83 


1.39 10^ 


4.81 10^ 










48 


3.84 


1.40 10^ 












49 


3.85 














Extr. 


4.01 


1.59 10^ 


6.32 10^ 


2.52 10^ 


1.00 10^ 


4.00 10^ 


1.59 W 


Cor. 1 


3.98 


1.59 10^ 


6.32 10^ 


2.52 10^ 


1.00 10^ 


4.00 10^ 


1.59 W 



a monotonously increasing sequence of nonnegative integers. In the case of linear convergent 
sequences, the choice £,£ = t£ with r G N can be used as in the case of the d^^-* transformation. 
It is easily seen that the new sequence also converges linearly with p = lim„_^oo (sn+i — s)/(s„ — 
s) = ■ For T > 1, both the effectiveness and the stability of the various transformations 
are increased as shown in Table || for the case r = 10. Note that this value was chosen to 
display basic features relevant to the stability analysis, and is not necessarily the optimal 
value. As in Table ^, the relative errors and the stability indices of some variants of the J 
transformation are displayed. These are nothing but the pj transformation for p — 1,2,3 
and the Levin transformation as applied to the sequence -^^"1 with remainder estimates 
LiJn = {jiT + P){snT — Snr-i) for (3=1. Sincc constant factors in the remainder estimates are 
irrelevant since the J transformation is invariant under any scaling a;„ — > aujn for a 7^ 0, the 
same results would have been obtained for ujn — {n + P/T){snT — Snr-i)- 

If the Levin transformation is applied to the series with partial sums Sn = Sm, and if the 
remainder estimates lu„ = [n + /3/t)(s7-„ — S(7-„)_2) are used, then one obtains nothing but 



the S-^'' transformation with — rl for r G N. 77 

It is seen from Table ^ that again the best accuracy is obtained for the 2 J transformation. 
The d^^^ transformation is worse, but better than the pJ transformations for p — 1 and p = 3. 
Note that the stability indices are now much smaller and do not limit the achievable accuracy 
for any of the transformations up to n = 30. The true value of the series was computed 
numerically by applying the 2 J transformation to the further sequence ■8^S40nS' and using 
64 decimal digits in the calculation. In this way, a sufficiently accurate approximation was 
obtained that was used to compute the relative errors in Tables | and | A comparison value 
was computed using the representation p. 29, Eq. (8)] 

C(., 1, = ^^(log 1/.)-^ + E C(. - .)^ (338) 

that holds for jloggj < 2n and s ^ N. Here, C,{z) denotes the Riemann zeta function. Both 
values agreed to all relevant decimal digits. 

In Table ^, we display stability indices corresponding to the acceleration of s„ with the 2 J 
transformation columnwise, as obtainable by using the sequence elements up to S50 = S500. 
In the row labelled Cor. |^, we display the limits of the vii'^ for large n, i.e., the quantities 

limr('=)=(i±4)' (339) 

that are the limits according to Corollary ^. It is seen that the values for finite n are still 
relatively far off the limits. In order to check numerically the validity of the corollary, we 
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Table 7: Extrapolation of series representation ( |340[ ) of the F„i{z) function using the 2 J 
transformation (z = 8 , m = 0) 



n 








K 


5 


-13.3 


0.3120747 


0.3143352 


0.3132981 


6 


14.7 


0.3132882 


0.3131147 


0.3133070 


7 


-13.1 


0.3132779 


0.3133356 


0.3133087 


8 


11.4 


0.3133089 


0.3133054 


0.3133087 


9 


-8.0 


0.3133083 


0.3133090 


0.3133087 



(k) 

extrapolated the values of all r„ for fixed k with n up to the maximal n for which there is 
an entry in the corresponding column of Table ^ using the u variant of the 1 J transformation. 
The results of the extrapolation are displayed in the row labelled Extr in Table ^ and coincide 
nearly perfectly with the values expected according to Corollary ^. 

As a final example, we consider the evaluation of the Fm{z) functions that are used in 
quantum chemistry calculations via the series representation 

00 

F,^{z) = ^(-z)Vj!(2m + 2j + 1) , (340) 



with partial sums 



sn = ^(-z)Vj!(2m + 2j + 1) . (341) 



In this case, for larger z, the convergence is rather slow although the convergence finally is 
hyperlinear. As a K variant, one may use 

V. = {Y.[-zy/{j + 1)! - (1 - e-^)/zj . (342) 

since (1 — e~^)/ z is a Kummer related series. The results for several variants in Table |^ show 
that the K variant is superior to u and t variants in this case. 

Many further numerical examples are given in the literature [^^l|-^,[50|,H. 
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A Stieltjes Series and Functions 

A Stieltjes series is a formal expansion 



= (343) 



with partial sums 



/nW = E(-l)'A^^-^'- (344) 

The coefficients /i„ are the moments of an uniquely given positive measure tpit) that has 
infinitely many different values on < i < oo p. 159]: 

/>oo 

pin = / e dil}{t), 71 e No . (345) 







Formally, the Stieltjes series can be identified with a Stieltjes integral 

If such an integral exists for a function / then the function is called a Stieltjes function. For 



every Stieltjes function there exist a unique asymptotical Stieltjes series (343), uniformly in 
every sector |arg(z)| < 9 for all 9 < ir. For any Stieltjes series, however, several different 
corresponding Stieltjes functions may exist. To ensure uniqueness, additional criteria are 
necessary Sec. 4.3]. 

In the context of convergence acceleration and summation of divergent series, it is impor- 
tant that for given z the tails f{z) — fn{z) of a Stieltjes series are bounded in absolute value 
by the by the next term of the series, 

|/(^)-/«(z)| <Mn+i^"+' ^> 0. (347) 

Hence, for Stieltjes series the remainder estimates may be chosen as 

= (-1)"+ Vn+i (348) 

This corresponds to w„ — Afn{z), i.e., to a t variant. 

B Derivation of the Recursive Scheme ( |14^ ) 

We show that for the divided difference operator □i*^'' = □i*^'' [I^XnJ-] the identity 

n« 'iix)e+i9ix)) = (349) 

Xn-\-k-\-l X'n 

holds. The proof is based on the Leibniz formula for divided differences (see, e.g., p. 50]) 
that yields upon use of {x)i+i — (x + i){x)e and Di^^\x) — Xn5k,a + 5k,i 



fc+i 



□('=+i)((x),+ig(x)) = lU^t'\{x)i9{x)) + U^iKx)U^^+^-'\{x),g{x)) 



(350) 



(x„ -I- £)Di'+'\{x),gix)) + ni%i{x),gix)) 
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Using the recursion relation of the divided differences, one obtains 



□n '{{x)i+i9{x)) = [Xn+e) + Dl^lj_{{x)ig{x)) . (351) 



Xn-\-k-\-l X'fi 

Simple algebra then yields Eg. ( |349|) . 

Comparison with Eq. (140) shows that using the interpolation conditions g„ = g{xn) = 
Sn/ujn E^nd £ = k — Hn Eq. (34£) yields the recursion for the numerators in Eq. (148), while the 
recursion for the denominators in Eq. (148) follows for £ = k — 1 and using the interpolation 
conditions g„ ~ 9{xn) = l/i^n- In each case, the initial conditions follow directly from Eq. 
(140) in combination with the definition of the divided difference operator: For fc = 0, we use 
(a)_i = l/(a - 1) and obtain 'dn\xn)k-ign = (a;„)-i5n = gn/{xn - !)• 



C Two Lemmata 

Lemma 1 Define 



(fe) c 



^ (n + jy+i 



where ( is a zero of of multiplicity m of Il^^\z) — X^^^o • ^^^^ 

.n+rrr fr + m\ (-1)™ 11^ 



-(C) , (n ^ oo) 



(352) 



(353) 



PROOF. Use 



to obtain 



1 I f°° 
— — = — exp(— ai)^ dt , a > 
a''+^ r! Jo 



(354) 



1 poo k. ^ ^„ „oo ^ 

A=-r VAf C"+^cxp(-(n+j»f' = ^ / exp(-nt)nW(Cexp(-i))rdi. (355) 



Taylor expansion of the polynomial yields due to the zero at ^ 



n('='(Cexp(-i)) 



(-C)" d"n('=)(a;) 



f" (1 + 0(0) 



(356) 



x=c 



Invoking Watson's lemma M, p. 263ff] completes the proof. □ 



Lemma 2 Assume that assumption (C-3') of Theorem^l^ holds. Further assume xl^'j A^'^^ 
for n —^ oo. Then, Eq. (28L) holds. 



PROOF. We have 



fy> exp e„ ^ - exp(je„) 



(357) 



for large n. Hence, 



fe fc 



E<]— -E^r(/^^-p(^»))-^' = n(^-)(i/p+<5„) 



j=0 j=0 



(358) 



Since the characteristic polynomial 11^'^^ (z) has a zero of order /i at z = 1/p according to the 
assumptions, Eq. (280) follows using Taylor expansion. □ 
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